[2024-12-16 17:49:15.314472] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT GROUP LOG INFO](palf_id=1, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=10697, avg_group_log_size=629) [2024-12-16 17:49:15.314509] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, append size=10697) [2024-12-16 17:49:15.315731] INFO [LIB] stat (utility.h:1176) [129964][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=127] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2190, this=0x2b460dffbbb0, extra_info="palf_id:1") [2024-12-16 17:49:15.315966] INFO [LIB] stat (utility.h:1193) [129964][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=224] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=301, this=0x2b46037b0530, extra_info="") [2024-12-16 17:49:15.316127] INFO [LIB] stat (utility.h:1176) [129963][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=112] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=48, this=0x2b460dffbde0, extra_info="palf_id:1") [2024-12-16 17:49:15.319841] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [128730][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=11] ====== traversal_flush timer task ====== [2024-12-16 17:49:15.320187] INFO [MDS] flush (mds_table_mgr.cpp:195) [128730][T1_Flush][T1][YB42C0A89F89-00062963DEB3797B-0-0] [lt=93] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:1152921504606846995}, rec_scn:{val:1734358874250062001, v:0}}, {tablet_id:{id:226}, rec_scn:{val:1734396020096295003, v:0}}, }, max_consequent_callbacked_scn={val:1734400155135379000, v:0}, *this={this:0x2b45ac7bc510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734358874250062001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1734358851997684000, v:0}, all_id_meta:{id_meta:[{limited_id:1734400166652098000, latest_log_ts:{val:1734400150064877001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734366149163780001, v:0}}, {limited_id:30000001, latest_log_ts:{val:1734359848272073001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b459ab8e030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-12-16 17:49:15.320324] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [128730][T1_Flush][T1][YB42C0A89F89-00062963DEB3797B-0-0] [lt=130] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-12-16 17:49:15.332792] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=97][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.334015] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-0006296420204414-0-0] [lt=50][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=100358, send_timestamp=1734400155233653, peer="192.168.159.142:49916", sz=1575) [2024-12-16 17:49:15.344912] INFO eloop_run (eloop.c:140) [128490][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1734400155344906, bytes: 19301116376, bw: 0.426210 MB/s, add_ts: 1002001, add_bytes: 447808 [2024-12-16 17:49:15.353154] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=44] worker thread began to shrink(tenant_->id()=1, group_id_=1, token=0) [2024-12-16 17:49:15.357289] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129267][T1_L0_G1][T1][Y0-0000000000000000-0-0] [lt=25] worker thread exit(tenant_->id()=1, workers_.get_size()=7) [2024-12-16 17:49:15.357315] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129267][T1_L0_G1][T0][Y0-0000000000000000-0-0] [lt=21] tenant thread end_run(id_=1, ret=0, thread_count_=192) [2024-12-16 17:49:15.367589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=0) [2024-12-16 17:49:15.368427] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [130058][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-12-16 17:49:15.373983] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1565) [129276][T1_L0_G1][T1][YB42C0A89F8A-00062963DF3972B0-0-0] [lt=50] receive register_req from acceptor, ignore(self="192.168.159.137:2882", palf_id=1, child={server:"192.168.159.138:2882", region:"sys_region", register_time_us:1734400155299329, keepalive_ts:-1}) [2024-12-16 17:49:15.374015] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1584) [129276][T1_L0_G1][T1][YB42C0A89F8A-00062963DF3972B0-0-0] [lt=31] handle_register_parent_req finished(ret=0, ret="OB_SUCCESS", palf_id=1, self="192.168.159.137:2882", child={server:"192.168.159.138:2882", region:"sys_region", register_time_us:1734400155299329, keepalive_ts:-1}, is_to_leader=true) [2024-12-16 17:49:15.397744] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641F95ACC3-0-0] [lt=38][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=101284, send_timestamp=1734400155296456, peer="192.168.159.142:49904", sz=265) [2024-12-16 17:49:15.398356] INFO [COMMON] print_status (ob_io_manager.cpp:288) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SERVER] net_in=437kB/s, net_out=324kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2024-12-16 17:49:15.398427] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 , local_read=0 0 , local_write=0 0 , remote_read=0 0 , remote_write=0 0 ) [2024-12-16 17:49:15.398505] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:326, idx_:0, tid_:128690}], io_callback_status=runner 0: thread_id=128690, queue_count=0, ) [2024-12-16 17:49:15.398606] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:452, idx_:0, tid_:130008}], io_callback_status=runner 0: thread_id=130008, queue_count=0, ) [2024-12-16 17:49:15.398707] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:5, bw:20254, [delay/us]:prepare:48, schedule:74, submit:6, rt:2697, total:2825) [2024-12-16 17:49:15.398736] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:4294967296, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:4}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=29368544, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0, 0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=1, iops=1, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2024-12-16 17:49:15.398781] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:5, avg_bw:20257, [delay/us]: prepare:48, schedule:74, submit:6, device:2697, total:2825) [2024-12-16 17:49:15.398845] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:392, idx_:0, tid_:129843}, {is_inited_:true, queue_.get_total():0, tg_id_:400, idx_:1, tid_:129951}], io_callback_status=runner 0: thread_id=129843, queue_count=0, runner 1: thread_id=129951, queue_count=0, ) [2024-12-16 17:49:15.398867] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4051, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:314, total:380) [2024-12-16 17:49:15.398893] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2024-12-16 17:49:15.398924] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4051, [delay/us]: prepare:0, schedule:0, submit:600000000, device:314, total:380) [2024-12-16 17:49:15.398988] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:271, idx_:0, tid_:128596}], io_callback_status=runner 0: thread_id=128596, queue_count=0, ) [2024-12-16 17:49:15.399009] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2024-12-16 17:49:15.399018] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt=, async_cnt= 0 [2024-12-16 17:49:15.405026] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-0006296423659F98-0-0] [lt=49][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=103458, send_timestamp=1734400155301488, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:15.406078] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=7028) [2024-12-16 17:49:15.408096] INFO [SERVER] try_release_schema (ob_server_schema_updater.cpp:465) [128459][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=10] schedule release schema task(ret=0, ret="OB_SUCCESS") [2024-12-16 17:49:15.408292] INFO [SHARE.SCHEMA] try_reset_another_allocator (ob_schema_mem_mgr.cpp:537) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=10] [SCHEMA_RELEASE] reset another allocator(tenant_id=1, pos=1) [2024-12-16 17:49:15.408345] INFO [SHARE.SCHEMA] try_gc_another_allocator (ob_multi_version_schema_service.cpp:3641) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=51] try gc another allocator(ret=0, tenant_id=1) [2024-12-16 17:49:15.408357] WDIAG [SHARE.SCHEMA] try_gc_tenant_schema_mgr_for_fallback (ob_multi_version_schema_service.cpp:3476) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=10][errcode=-4002] invalid tenant_id(ret=-4002, tenant_id=1) [2024-12-16 17:49:15.408365] INFO [SHARE.SCHEMA] try_gc_tenant_schema_mgr_for_fallback (ob_multi_version_schema_service.cpp:3496) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=8] try gc schema mgr for fallback(ret=-4002, tenant_id=1) [2024-12-16 17:49:15.408373] WDIAG [SHARE.SCHEMA] try_gc_existed_tenant_schema_mgr (ob_multi_version_schema_service.cpp:3570) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=6][errcode=-4002] fail to gc tenant schema mgr for fallback(ret=-4002, ret="OB_INVALID_ARGUMENT", tenant_id=1) [2024-12-16 17:49:15.408389] INFO [SHARE.SCHEMA] try_gc_current_allocator (ob_multi_version_schema_service.cpp:3728) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=8] finish gc current allocator's schema mgr which is in slot(ret=0, ret="OB_SUCCESS", tenant_id=1, cost_ts=7) [2024-12-16 17:49:15.408400] INFO [SHARE.SCHEMA] try_reset_another_allocator (ob_schema_mem_mgr.cpp:537) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=8] [SCHEMA_RELEASE] reset another allocator(tenant_id=1001, pos=1) [2024-12-16 17:49:15.408407] INFO [SHARE.SCHEMA] try_gc_another_allocator (ob_multi_version_schema_service.cpp:3641) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=6] try gc another allocator(ret=0, tenant_id=1001) [2024-12-16 17:49:15.408425] INFO [SHARE.SCHEMA] try_reset_allocator (ob_schema_mem_mgr.cpp:508) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=5] [SCHEMA_RELEASE] reset schema_mem_mgr(tenant_id=1001) [2024-12-16 17:49:15.408432] INFO [SHARE.SCHEMA] try_reset_allocator (ob_schema_mem_mgr.cpp:518) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=7] [SCHEMA_RELEASE] reset another schema_mem_mgr(tenant_id=1001) [2024-12-16 17:49:15.408438] INFO [SHARE.SCHEMA] try_gc_tenant_schema_mgr_for_fallback (ob_multi_version_schema_service.cpp:3496) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=5] try gc schema mgr for fallback(ret=0, tenant_id=1001) [2024-12-16 17:49:15.408447] INFO [SHARE.SCHEMA] try_gc_current_allocator (ob_multi_version_schema_service.cpp:3728) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=5] finish gc current allocator's schema mgr which is in slot(ret=0, ret="OB_SUCCESS", tenant_id=1001, cost_ts=2) [2024-12-16 17:49:15.408455] INFO [SHARE.SCHEMA] try_reset_another_allocator (ob_schema_mem_mgr.cpp:537) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=7] [SCHEMA_RELEASE] reset another allocator(tenant_id=1002, pos=1) [2024-12-16 17:49:15.408462] INFO [SHARE.SCHEMA] try_gc_another_allocator (ob_multi_version_schema_service.cpp:3641) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=6] try gc another allocator(ret=0, tenant_id=1002) [2024-12-16 17:49:15.408473] INFO [SHARE.SCHEMA] try_reset_allocator (ob_schema_mem_mgr.cpp:508) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=5] [SCHEMA_RELEASE] reset schema_mem_mgr(tenant_id=1002) [2024-12-16 17:49:15.408479] INFO [SHARE.SCHEMA] try_reset_allocator (ob_schema_mem_mgr.cpp:518) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=6] [SCHEMA_RELEASE] reset another schema_mem_mgr(tenant_id=1002) [2024-12-16 17:49:15.408484] INFO [SHARE.SCHEMA] try_gc_tenant_schema_mgr_for_fallback (ob_multi_version_schema_service.cpp:3496) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=5] try gc schema mgr for fallback(ret=0, tenant_id=1002) [2024-12-16 17:49:15.408492] INFO [SHARE.SCHEMA] try_gc_current_allocator (ob_multi_version_schema_service.cpp:3728) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=5] finish gc current allocator's schema mgr which is in slot(ret=0, ret="OB_SUCCESS", tenant_id=1002, cost_ts=2) [2024-12-16 17:49:15.408500] INFO [SERVER] process_release_task (ob_server_schema_updater.cpp:353) [128507][SerScheQueue1][T0][YB42C0A89F89-00062963E16381BC-0-0] [lt=6] try to release schema(ret=0, ret="OB_SUCCESS") [2024-12-16 17:49:15.416335] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [128568][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1734400155416310], gts:1734400155416071000, latest_srr:[mts=1734400155416310]}) [2024-12-16 17:49:15.416374] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [128568][TsMgr][T0][Y0-0000000000000000-0-0] [lt=37] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-12-16 17:49:15.417410] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=23][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.417461] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=46][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.417480] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=12][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E742066696C652064617461, cstr: tenant file data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: CD2A2A816D290600, int: 1734400155462349}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: CD2A2A816D290600, int: 1734400155462349}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.417801] INFO [STORAGE] print_count (ob_query_iterator_factory.cpp:50) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=89] ObQueryIteratorFactory statistics(multi_scan_merge_alloc_count=0, multi_scan_merge_release_count=0, multi_get_merge_alloc_count=0, multi_get_merge_release_count=0, table_scan_alloc_count=0, table_scan_release_count=0, insert_dup_alloc_count=100682, insert_dup_release_count=100682, col_map_alloc_count=0, col_map_release_count=0) [2024-12-16 17:49:15.417857] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=39][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.419560] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=62] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:7389}, to_seq_no={branch:0, seq:7384}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484972} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.419707] INFO [STORAGE.TRANS] statistics_ (ob_trans_rpc.cpp:678) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=43] rpc statistics(total_trans_msg_count=1, total_batch_msg_count=0) [2024-12-16 17:49:15.419721] INFO [STORAGE.TRANS] process (ob_trans_rpc.cpp:152) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5A-0-0] [lt=13] transaction rpc statistics(total_rt=9080, total_process=52, avg_rt=171) [2024-12-16 17:49:15.428764] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629642351F7C5-0-0] [lt=28][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=100618, send_timestamp=1734400155328141, peer="192.168.159.142:49912", sz=1543) [2024-12-16 17:49:15.431416] WDIAG [SERVER] runTimerTask (ob_service.cpp:206) [128459][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4007] renew remote rs master failed(ret=-4007, ret="OB_NOT_SUPPORTED") [2024-12-16 17:49:15.431829] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5B-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1734400155431451000, start_id=1734400155431451000, end_id=1734400155431451001) [2024-12-16 17:49:15.432878] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.440573] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5C-0-0] [lt=12][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.440662] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5C-0-0] [lt=43][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.440684] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5C-0-0] [lt=15][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 18, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206261636B75702064617461, cstr: tenant backup data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b865, hex: AA8E2A816D290600, int: 1734400155487914}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86d, hex: AA8E2A816D290600, int: 1734400155487914}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b875, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87d, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.440847] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5C-0-0] [lt=92][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.441038] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=79] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2024-12-16 17:49:15.441082] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=70, get_cur_idx()=62, get_pop_idx()=62) [2024-12-16 17:49:15.443142] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128853][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5C-0-0] [lt=17] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:4693}, to_seq_no={branch:0, seq:4688}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484973} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.453086] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [128562][Blacklist][T0][Y0-0000000000000000-0-0] [lt=33] blacklist_loop exec finished(cost_time=31, is_enabled=true, send_cnt=0) [2024-12-16 17:49:15.454263] INFO [LIB] stat (utility.h:1176) [129796][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1917, this=0x2b46342f9bb0, extra_info="palf_id:1001") [2024-12-16 17:49:15.454305] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129796][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=1220) [2024-12-16 17:49:15.454405] INFO [LIB] stat (utility.h:1193) [129796][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1632, this=0x2b45db5f8c70, extra_info="") [2024-12-16 17:49:15.454732] INFO [LIB] stat (utility.h:1176) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x2b46342f9de0, extra_info="palf_id:1001") [2024-12-16 17:49:15.463383] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [129863][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=29] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2024-12-16 17:49:15.463657] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [129863][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=223] temporary file module use no blocks [2024-12-16 17:49:15.463674] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [129863][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2024-12-16 17:49:15.463691] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1082) [129863][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=14] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=5313, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2024-12-16 17:49:15.463705] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [129863][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=12] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:168636022578, flush_io_finished_ret_:0, flush_io_finished_round_:40986, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2024-12-16 17:49:15.465095] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [128840][T1_L0_G5][T1][YB42C0A89F8F-000629642E4CAD5E-0-0] [lt=28] handle gts request statistics(total_rt=3753, total_cnt=535, avg_rt=7.001865671641790634e+00, avg_cnt=5.350000000000000000e+01) [2024-12-16 17:49:15.467480] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5E-0-0] [lt=43][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.467537] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5E-0-0] [lt=52][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.467555] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5E-0-0] [lt=12][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420746D702064617461, cstr: tenant tmp data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b862, hex: FDF42A816D290600, int: 1734400155514109}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86a, hex: FDF42A816D290600, int: 1734400155514109}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b872, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87a, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.467790] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD5E-0-0] [lt=156][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.468213] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [129857][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=133805, offset=39930501}, end_cursor:ObLogCursor{file_id=1, log_id=133806, offset=39930806}, is_inited:true, is_local:false, buf_size:8192, buf:0x2b457696a050, len:1403, log_data_len:305, seq:133805, flush_finish:false, flush_ret:0}) [2024-12-16 17:49:15.468736] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [129083][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F412-0-0] [lt=28] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2024-12-16 17:49:15.468787] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [129083][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F412-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1734400155416071000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1734400155416071000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"192.168.159.137:2882"}, offline_scn={val:18446744073709551615, v:3}) [2024-12-16 17:49:15.470063] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5E-0-0] [lt=49] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:4921}, to_seq_no={branch:0, seq:2438}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484974} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.472768] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [128550][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=47] skip inspect bad block(last_check_time=1734358755886704, last_macro_idx=-1) [2024-12-16 17:49:15.477820] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629641F33D3D8-0-0] [lt=56][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1808, fly_ts=103423, send_timestamp=1734400155374394, peer="192.168.159.142:49916", sz=256) [2024-12-16 17:49:15.477882] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128840][T1_L0_G5][T1][YB42C0A89F8E-000629641F33D3D8-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1734400155469681000, start_id=1734400155469681000, end_id=1734400155469681001) [2024-12-16 17:49:15.481292] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD5F-0-0] [lt=8] get number(ret=0, service_type_=0, range=1, base_id=1734400155481191000, start_id=1734400155481191000, end_id=1734400155481191001) [2024-12-16 17:49:15.482826] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [76737][T1001_L0_G5][T1001][YB42C0A89F8E-000629641F33D3D9-0-0] [lt=9] get number(ret=0, service_type_=0, range=1, base_id=1734400155482522000, start_id=1734400155482522000, end_id=1734400155482522001) [2024-12-16 17:49:15.483540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1430695936, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:15.483892] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [129857][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=106] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=133806, offset=39930806}, end_cursor:ObLogCursor{file_id=1, log_id=133807, offset=39931103}, is_inited:true, is_local:false, buf_size:8192, buf:0x2b457696e050, len:1098, log_data_len:297, seq:133806, flush_finish:false, flush_ret:0}) [2024-12-16 17:49:15.487935] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=440398, clean_num=62914) [2024-12-16 17:49:15.488803] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [129083][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F412-0-0] [lt=25] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2024-12-16 17:49:15.488998] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [129083][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F412-0-0] [lt=31] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1734400155416071000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1734400155416071000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"192.168.159.137:2882"}, offline_scn={val:18446744073709551615, v:3}) [2024-12-16 17:49:15.492829] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD60-0-0] [lt=43][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.492858] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD60-0-0] [lt=26][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.492873] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD60-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420746D702064617461, cstr: tenant tmp data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b862, hex: 1C502B816D290600, int: 1734400155537436}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86a, hex: 1C502B816D290600, int: 1734400155537436}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b872, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87a, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.493058] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD60-0-0] [lt=62][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.495596] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD60-0-0] [lt=42] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:10336}, to_seq_no={branch:0, seq:6932}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484975} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.498048] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [129857][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=133807, offset=39931103}, end_cursor:ObLogCursor{file_id=1, log_id=133808, offset=39931400}, is_inited:true, is_local:false, buf_size:8192, buf:0x2b4576972050, len:801, log_data_len:297, seq:133807, flush_finish:false, flush_ret:0}) [2024-12-16 17:49:15.514856] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1734400155511435000, start_id=1734400155511435000, end_id=1734400155511435001) [2024-12-16 17:49:15.519043] INFO [LIB] stat (utility.h:1176) [129283][T1001_L0_G1][T1001][YB42C0A89F8B-00062963EEDFC278-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=20, this=0x2b460dff16a0, extra_info="palf_id:1") [2024-12-16 17:49:15.519068] INFO [LIB] stat (utility.h:1176) [129283][T1001_L0_G1][T1001][YB42C0A89F8B-00062963EEDFC278-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=4899, this=0x2b460dff18d0, extra_info="palf_id:1") [2024-12-16 17:49:15.519079] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129283][T1001_L0_G1][T1001][YB42C0A89F8B-00062963EEDFC278-0-0] [lt=9] [PALF STAT LOG TASK TIME](palf_id=1, self="192.168.159.137:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=103, avg_log_submit_to_flush_time=2206, avg_log_submit_to_slide_time=4796) [2024-12-16 17:49:15.519334] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD62-0-0] [lt=15][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.519379] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD62-0-0] [lt=41][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.519450] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD62-0-0] [lt=12][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420636C6F672064617461, cstr: tenant clog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: B0B92B816D290600, int: 1734400155564464}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: B0B92B816D290600, int: 1734400155564464}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.519603] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD62-0-0] [lt=147][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.521466] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128781][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD62-0-0] [lt=30] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:11032}, to_seq_no={branch:0, seq:4834}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484976} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.530025] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128850][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD63-0-0] [lt=209] get number(ret=0, service_type_=0, range=1, base_id=1734400155529585000, start_id=1734400155529585000, end_id=1734400155529585001) [2024-12-16 17:49:15.533339] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.538805] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD64-0-0] [lt=12][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.538835] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD64-0-0] [lt=26][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.538852] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD64-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E742066696C652064617461, cstr: tenant file data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: BF062C816D290600, int: 1734400155584191}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: BF062C816D290600, int: 1734400155584191}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.539030] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD64-0-0] [lt=126][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.541254] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128853][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD64-0-0] [lt=43] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:9190}, to_seq_no={branch:0, seq:3435}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484977} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.552866] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [129898][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=207] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}, {id:1002}]) [2024-12-16 17:49:15.560607] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD66-0-0] [lt=13][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.560706] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD66-0-0] [lt=95][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.560726] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD66-0-0] [lt=12][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E742066696C652064617461, cstr: tenant file data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: 7A552C816D290600, int: 1734400155604346}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: 7A552C816D290600, int: 1734400155604346}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.560932] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD66-0-0] [lt=132][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.562140] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [129842][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=88] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:704, free_obj_hold_cnt:13, allocator used:2759016, allocator total:2937600}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():126976, full allocator used:1600, full allocator total:192512}, tablets_mem=3130112, tablets_mem_limit=858993440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=704) [2024-12-16 17:49:15.562837] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD66-0-0] [lt=27] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:8095}, to_seq_no={branch:0, seq:4583}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484978} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.569717] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=95] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=2516560, replace_num=31457) [2024-12-16 17:49:15.569760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=10) [2024-12-16 17:49:15.580740] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641FA3C0C5-0-0] [lt=30][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100843, send_timestamp=1734400155479892, peer="192.168.159.142:49904", sz=239) [2024-12-16 17:49:15.584686] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-000629641FA3C0C6-0-0] [lt=28][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=102673, send_timestamp=1734400155482009, peer="192.168.159.142:50522", sz=240) [2024-12-16 17:49:15.585789] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128784][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD68-0-0] [lt=43][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.585848] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128784][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD68-0-0] [lt=54][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.585917] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128784][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD68-0-0] [lt=61][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b45d3e0bb90, local_datums:0x2b45d3e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b45d3e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 18, flag: 0, null: 0, ptr: 0x2b45d3e0b853, hex: 74656E616E74206261636B75702064617461, cstr: tenant backup data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b865, hex: 28B22C816D290600, int: 1734400155628072}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b86d, hex: 28B22C816D290600, int: 1734400155628072}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b875, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b45d3e0b87d, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.586208] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128784][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD68-0-0] [lt=201][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.588647] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629641FA3C0C7-0-0] [lt=25][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100332, send_timestamp=1734400155488311, peer="192.168.159.142:49916", sz=240) [2024-12-16 17:49:15.588963] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128850][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD68-0-0] [lt=53] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:3428}, to_seq_no={branch:0, seq:3423}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484979} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.589488] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF_DUMP](palf_id=1, self="192.168.159.137:2882", [SlidingWindow]={palf_id:1, self:"192.168.159.137:2882", lsn_allocator:{max_log_id:418385, max_lsn:143717875, max_scn:{val:1734400155416071001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:143717875}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:101774835}}, last_submit_lsn:{lsn:143717753}, last_submit_end_lsn:{lsn:143717875}, last_submit_log_id:418385, last_submit_log_pid:1, max_flushed_lsn:{lsn:143717753}, max_flushed_end_lsn:{lsn:143717875}, max_flushed_log_pid:1, committed_end_lsn:{lsn:143717875}, last_slide_log_id:418385, last_slide_scn:{val:1734400155416071001, v:0}, last_slide_lsn:{lsn:143717753}, last_slide_end_lsn:{lsn:143717875}, last_slide_log_pid:1, last_slide_log_accum_checksum:2987859765, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x2b461f6c2530}, [StateMgr]={this:0x2b461f6c6830, self:"192.168.159.137:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"192.168.159.137:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:418386, is_changing_config_with_arb:false, reconfirm_start_time_us:1734359174595915, palf_role_change_cb:0x2b461f6cd270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"192.168.159.137:2882", alive_paxos_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, alive_paxos_replica_num:3, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x2b461f6c3c70}, [ModeMgr]={palf_id:1, self:"192.168.159.137:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:1734359174803638, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:201314304}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1/meta", dir_fd:171, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x2b461f6c89f8, flashback_version:0}, log_storage:{log_tail:{lsn:143717875}, readable_log_tail:{lsn:143717875}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:1734396980194752003, v:0}, curr_block_id:2, palf_id:1}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1/log", dir_fd:173, min_block_id:0, max_block_id:3, curr_writable_block_id:2}, logical_block_size_:67104768, curr_block_writable_size_:57596429, block_header_serialize_buf_:0x2b461f6ca6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1734359174593349, this:0x2b461f6c6f70}, [Reconfirm]={palf_id:1, self:"192.168.159.137:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:2"192.168.159.138:2882";"192.168.159.139:2882";, curr_paxos_follower_list:2{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, majority_cnt:2, majority_max_log_server:"192.168.159.138:2882", majority_max_accept_pid:0, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1734359174596151, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x2b461f6c69b0}) [2024-12-16 17:49:15.589975] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=477] [PALF_DUMP](palf_id=1, self="192.168.159.137:2882", ack_info_list=[{member:{server:"192.168.159.137:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155556379, last_flushed_end_lsn:{lsn:143717875}}, {member:{server:"192.168.159.138:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155557465, last_flushed_end_lsn:{lsn:143717875}}, {member:{server:"192.168.159.139:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155557376, last_flushed_end_lsn:{lsn:143717875}}]) [2024-12-16 17:49:15.590048] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=38] current log_task status(palf_id=1, self="192.168.159.137:2882", log_id=418386, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"192.168.159.137:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155556379, last_flushed_end_lsn:{lsn:143717875}}, {member:{server:"192.168.159.138:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155557465, last_flushed_end_lsn:{lsn:143717875}}, {member:{server:"192.168.159.139:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155557376, last_flushed_end_lsn:{lsn:143717875}}]) [2024-12-16 17:49:15.590306] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=244] [PALF_DUMP](palf_id=1001, self="192.168.159.137:2882", [SlidingWindow]={palf_id:1001, self:"192.168.159.137:2882", lsn_allocator:{max_log_id:391139, max_lsn:47606658, max_scn:{val:1734400155416071001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:47606658}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:5663618}}, last_submit_lsn:{lsn:47606536}, last_submit_end_lsn:{lsn:47606658}, last_submit_log_id:391139, last_submit_log_pid:1, max_flushed_lsn:{lsn:47606536}, max_flushed_end_lsn:{lsn:47606658}, max_flushed_log_pid:1, committed_end_lsn:{lsn:47606658}, last_slide_log_id:391139, last_slide_scn:{val:1734400155416071001, v:0}, last_slide_lsn:{lsn:47606536}, last_slide_end_lsn:{lsn:47606658}, last_slide_log_pid:1, last_slide_log_accum_checksum:1217806232, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x2b46342ee530}, [StateMgr]={this:0x2b46342f2830, self:"192.168.159.137:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"192.168.159.137:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:391140, is_changing_config_with_arb:false, reconfirm_start_time_us:1734359215339426, palf_role_change_cb:0x2b46342f9270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"192.168.159.137:2882", alive_paxos_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, alive_paxos_replica_num:3, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x2b46342efc70}, [ModeMgr]={palf_id:1001, self:"192.168.159.137:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202081794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202081794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202081794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:1734359215539836, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1734359202081794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1734359202081794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202081794000, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1001/meta", dir_fd:177, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x2b46342f49f8, flashback_version:0}, log_storage:{log_tail:{lsn:47606658}, readable_log_tail:{lsn:47606658}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1734359202081794001, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1001/log", dir_fd:178, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:19498110, block_header_serialize_buf_:0x2b46342f66b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1734359215331829, this:0x2b46342f2f70}, [Reconfirm]={palf_id:1001, self:"192.168.159.137:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:2"192.168.159.139:2882";"192.168.159.138:2882";, curr_paxos_follower_list:2{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, majority_cnt:2, majority_max_log_server:"192.168.159.139:2882", majority_max_accept_pid:0, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1734359215339824, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x2b46342f29b0}) [2024-12-16 17:49:15.590599] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=287] [PALF_DUMP](palf_id=1001, self="192.168.159.137:2882", ack_info_list=[{member:{server:"192.168.159.137:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155556388, last_flushed_end_lsn:{lsn:47606658}}, {member:{server:"192.168.159.138:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155555031, last_flushed_end_lsn:{lsn:47606658}}, {member:{server:"192.168.159.139:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155559304, last_flushed_end_lsn:{lsn:47606658}}]) [2024-12-16 17:49:15.590620] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=18] current log_task status(palf_id=1001, self="192.168.159.137:2882", log_id=391140, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"192.168.159.137:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155556388, last_flushed_end_lsn:{lsn:47606658}}, {member:{server:"192.168.159.138:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155555031, last_flushed_end_lsn:{lsn:47606658}}, {member:{server:"192.168.159.139:2882", timestamp:1, flag:0}, last_ack_time_us:1734400155559304, last_flushed_end_lsn:{lsn:47606658}}]) [2024-12-16 17:49:15.590787] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [129875][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=122] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x2b45f416a2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-12-16 17:49:15.599331] WDIAG begin (ob_hashtable.h:954) [128859][T1_L0_G0][T1][YB42C0A89F89-00062963E3535A4E-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bcec65 0x10e56fc4 0x10c3334e 0x127d5d5e 0x128943bc 0x79a8fba 0x7b14b1e 0x7b14a62 0x7b14a62 0x7b1436d 0x7a43500 0x7a356ac 0x7a348d8 0x7a344f4 0x11dd5114 0x7a3376f 0x7a2ba1e 0x7a26ade 0x7a155ee 0x76c8f84 0x76c547e 0x74f340c 0x74d6e52 0x74cce31 0x74c555c 0x74c39ef 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d [2024-12-16 17:49:15.601689] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [128859][T1_L0_G0][T1][YB42C0A89F89-00062963E3535A4E-0-0] [lt=27][errcode=0] set logical del time(cache_obj->get_logical_del_time()=168637161014, cache_obj->added_lc()=false, cache_obj->get_object_id()=95446, cache_obj->get_tenant_id()=1, lbt()="0x7bcec65 0xfb1dce8 0x74e3164 0x74d8299 0x74cce31 0x74c555c 0x74c39ef 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d") [2024-12-16 17:49:15.602286] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629641F95ACC5-0-0] [lt=192][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=105533, send_timestamp=1734400155496751, peer="192.168.159.142:49912", sz=265) [2024-12-16 17:49:15.605221] WDIAG get_refactored (ob_hashtable.h:1120) [128782][T1_L0_G0][T1][YB42C0A89F89-00062963DEE3E836-0-0] [lt=20][errcode=-4201] hashtable not init [2024-12-16 17:49:15.605320] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [128782][T1_L0_G0][T1][YB42C0A89F89-00062963DEE3E836-0-0] [lt=97] get cursor info failed(cursor_id=8254, get_sessid()=3221494520) [2024-12-16 17:49:15.614609] WDIAG begin (ob_hashtable.h:954) [128851][T1_L0_G0][T1][YB42C0A89F8E-000629641EE20779-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bcec65 0x10e56fc4 0x10c3334e 0x127d5d5e 0x128943bc 0x79a8fba 0x7b14b1e 0x7b14a62 0x7b14a62 0x7b1436d 0x7a43500 0x7a356ac 0x7a348d8 0x7a344f4 0x11dd5114 0x7a3376f 0x7a2ba1e 0x7a26ade 0x7a155ee 0x76c8f84 0x76c547e 0x1287b4fd 0x108aab76 0x108aa665 0x7be5a58 0x74c49cc 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d [2024-12-16 17:49:15.618597] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [128851][T1_L0_G0][T1][YB42C0A89F8E-000629641EE20779-0-0] [lt=102][errcode=0] set logical del time(cache_obj->get_logical_del_time()=168637177993, cache_obj->added_lc()=false, cache_obj->get_object_id()=95447, cache_obj->get_tenant_id()=1, lbt()="0x7bcec65 0xfb1dce8 0x750765e 0xfa904bd 0xf0e183a 0xefff187 0x74c3b9f 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d") [2024-12-16 17:49:15.619281] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [129885][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-12-16 17:49:15.619332] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [129885][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=39] get_disk_usage(ret=0, capacity(MB):=1536, used(MB):=421) [2024-12-16 17:49:15.625482] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6A-0-0] [lt=13][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.625534] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6A-0-0] [lt=47][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.625553] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6A-0-0] [lt=13][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 18, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206261636B75702064617461, cstr: tenant backup data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b865, hex: 0B5A2D816D290600, int: 1734400155671051}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86d, hex: 0B5A2D816D290600, int: 1734400155671051}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b875, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87d, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.625807] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6A-0-0] [lt=63][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.627045] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128853][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD6A-0-0] [lt=42] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:10261}, to_seq_no={branch:0, seq:10256}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484980} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.633491] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=87] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"192.168.159.137:2882", switch_to_leader_ts:-1}) [2024-12-16 17:49:15.633731] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=238] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"192.168.159.137:2882", switch_to_leader_ts:-1}) [2024-12-16 17:49:15.633749] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.644598] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=13] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=32212254, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=14558208) [2024-12-16 17:49:15.644690] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=87] Construct Queue Num(construct_num=0, get_push_idx()=73, get_cur_idx()=65, get_pop_idx()=65) [2024-12-16 17:49:15.649231] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [128983][T1_L0_G25][T1][YB42C0A89F89-00062963E003A9B9-0-0] [lt=27] [RS_MGR] force set rs list(master_rs="192.168.159.137:2882") [2024-12-16 17:49:15.649282] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [128983][T1_L0_G25][T1][YB42C0A89F89-00062963E003A9B9-0-0] [lt=41] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"192.168.159.137:2882", server_id:1, rs_addr:"192.168.159.137:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"192.168.159.137:2882", sql_port:2881, build_version:"4.3.4.0_100000162024110717-82547d6edc6ea98ba710e376a736a9a850499a06(Nov 7 2024 17:28:11)", start_service_time:1734358821295833, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=65) [2024-12-16 17:49:15.651783] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6E-0-0] [lt=37][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.651814] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6E-0-0] [lt=27][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.651829] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6E-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420636C6F672064617461, cstr: tenant clog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: 04C42D816D290600, int: 1734400155698180}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: 04C42D816D290600, int: 1734400155698180}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.651972] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD6E-0-0] [lt=67][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.654833] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD6E-0-0] [lt=126] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5828}, to_seq_no={branch:0, seq:2279}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484982} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.658423] INFO [OCCAM] get_idx (ob_occam_time_guard.h:223) [129288][T1002_L0_G1][T1002][YB42C0A89F8A-00062963E9BEECEB-0-0] [lt=18] init point thread id with(&point=0x55b81b081000, idx_=2312, point=[thread id=129288, timeout ts=16:00:00.0, last click point="(null):(null):0", last click ts=16:00:00.0], thread_id=129288) [2024-12-16 17:49:15.660218] INFO [LIB] stat (utility.h:1176) [129797][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=177] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1307, this=0x2b463a425bb0, extra_info="palf_id:1002") [2024-12-16 17:49:15.660416] INFO [LIB] stat (utility.h:1193) [129797][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=166, this=0x2b45db5f93b0, extra_info="") [2024-12-16 17:49:15.660438] INFO [LIB] stat (utility.h:1176) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=63, this=0x2b463a425de0, extra_info="palf_id:1002") [2024-12-16 17:49:15.665731] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128847][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD6F-0-0] [lt=100] get number(ret=0, service_type_=0, range=1, base_id=1734400155665405000, start_id=1734400155665405000, end_id=1734400155665405001) [2024-12-16 17:49:15.673541] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=13] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=103079214, evict_high_size_level=530841, evict_batch_count=0, elapse_time=0, size_used=65536, mem_used=97747968) [2024-12-16 17:49:15.673584] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=29, get_cur_idx()=21, get_pop_idx()=20) [2024-12-16 17:49:15.675775] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD70-0-0] [lt=67][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.675816] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD70-0-0] [lt=36][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.676094] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD70-0-0] [lt=268][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420636C6F672064617461, cstr: tenant clog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: 9D202E816D290600, int: 1734400155721885}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: 9D202E816D290600, int: 1734400155721885}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.676316] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD70-0-0] [lt=102][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.678793] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128853][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD70-0-0] [lt=58] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:11279}, to_seq_no={branch:0, seq:4859}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484983} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.681824] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] [COMPACTION DAG STATUS] (start_time=1734400145676495, end_time=1734400155681822, dag_status={}) [2024-12-16 17:49:15.681868] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681883] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681892] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681907] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681929] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681986] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=55] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.681998] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.682006] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:15.682013] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=6] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682025] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682033] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682042] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682050] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682058] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682116] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=57] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682158] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682166] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682175] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682260] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=84] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=53] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682334] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682342] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682350] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682358] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682367] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682374] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682382] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682389] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682403] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682411] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682418] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682425] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682432] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682439] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682446] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682453] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682482] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682569] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=85] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682629] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=59] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682639] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682647] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682655] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682664] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682680] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682688] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682696] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682720] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682728] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682736] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682744] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682752] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682760] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682776] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682783] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682876] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=92] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682889] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682897] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682905] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682921] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682930] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682938] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.682946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.683002] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=54] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.683015] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.683023] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.683031] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.683039] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:15.683049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3607) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-12-16 17:49:15.683057] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-12-16 17:49:15.683064] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-12-16 17:49:15.683070] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=5] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-12-16 17:49:15.683075] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-12-16 17:49:15.683080] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=5] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-12-16 17:49:15.683085] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=5] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-12-16 17:49:15.683090] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-12-16 17:49:15.683094] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=5] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-12-16 17:49:15.683098] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-12-16 17:49:15.683103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4310) [129834][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=4] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2024-12-16 17:49:15.688913] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1432793088, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:15.696585] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD72-0-0] [lt=111][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.696702] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD72-0-0] [lt=112][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.696725] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD72-0-0] [lt=14][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 17, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206C6F63616C2064617461, cstr: tenant local data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b864, hex: 5D6B2E816D290600, int: 1734400155741021}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86c, hex: 5D6B2E816D290600, int: 1734400155741021}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b874, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87c, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.696891] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD72-0-0] [lt=75][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.698378] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128853][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD72-0-0] [lt=41] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:2389}, to_seq_no={branch:0, seq:2384}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484984} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.702720] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-0006296423659F9B-0-0] [lt=35][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100607, send_timestamp=1734400155602109, peer="192.168.159.142:49904", sz=265) [2024-12-16 17:49:15.711976] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-0006296424B5A144-0-0] [lt=33][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100411, send_timestamp=1734400155611560, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:15.718575] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:15.718668] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=90][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:15.720173] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1027) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=61] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1734359134781082, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x2b460dff7a30, log_storage_:{log_tail:{lsn:418092441}, readable_log_tail:{lsn:418092441}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:402628608}, min_scn:{val:1734398529621931001, v:0}, curr_block_id:6, palf_id:1}, block_mgr:{log_dir:"/ob/data/clog/tenant_1001/1/log", dir_fd:168, min_block_id:1, max_block_id:7, curr_writable_block_id:6}, logical_block_size_:67104768, curr_block_writable_size_:51640935, block_header_serialize_buf_:0x2b460dff86b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:0, read_io_size:0, read_disk_cost_ts:0, start_lsn:{lsn:0}}}}}}) [2024-12-16 17:49:15.721555] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128854][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD74-0-0] [lt=51][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.721663] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128854][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD74-0-0] [lt=103][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.721683] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128854][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD74-0-0] [lt=14][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4661e0bb90, local_datums:0x2b4661e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4661e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4661e0b853, hex: 74656E616E7420736C6F672064617461, cstr: tenant slog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b863, hex: 29CB2E816D290600, int: 1734400155765545}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b86b, hex: 29CB2E816D290600, int: 1734400155765545}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4661e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.721870] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128854][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD74-0-0] [lt=79][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.723984] INFO [SHARE] pre_run (ob_tenant_base.cpp:319) [129289][][T1][Y0-0000000000000000-0-0] [lt=0] tenant thread pre_run(MTL_ID()=1, ret=0, thread_count_=193) [2024-12-16 17:49:15.724098] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [129289][][T1][Y0-0000000000000000-0-0] [lt=111] Init thread local success [2024-12-16 17:49:15.724184] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD74-0-0] [lt=102] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:10600}, to_seq_no={branch:0, seq:6966}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484985} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.724810] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get obj error(ret=-4152) [2024-12-16 17:49:15.724827] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2024-12-16 17:49:15.725237] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:509) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=30] worker thread created(tenant_->id()=1, group_id_=1, token=1) [2024-12-16 17:49:15.733649] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.733835] INFO [OCCAM] get_idx (ob_occam_time_guard.h:223) [129289][T1_L0_G1][T1][YB42C0A89F8B-00062963EF1F82E3-0-0] [lt=9] init point thread id with(&point=0x55b81b081040, idx_=2313, point=[thread id=129289, timeout ts=16:00:00.0, last click point="(null):(null):0", last click ts=16:00:00.0], thread_id=129289) [2024-12-16 17:49:15.741150] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [128694][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=21][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-12-16 17:49:15.741305] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [128694][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=71][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2024-12-16 17:49:15.744071] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128856][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD76-0-0] [lt=42][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.744101] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128856][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD76-0-0] [lt=26][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.744116] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128856][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD76-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b467de0bb90, local_datums:0x2b467de0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b467de0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 17, flag: 0, null: 0, ptr: 0x2b467de0b853, hex: 74656E616E74206C6F63616C2064617461, cstr: tenant local data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b864, hex: 671E2F816D290600, int: 1734400155786855}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b86c, hex: 671E2F816D290600, int: 1734400155786855}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b874, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b467de0b87c, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.744237] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128856][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD76-0-0] [lt=63][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.746224] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128853][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD76-0-0] [lt=45] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:11085}, to_seq_no={branch:0, seq:7571}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484986} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.753151] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-12-16 17:49:15.753220] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"192.168.159.137:2882", has_set_deleted:false}, append size=1220) [2024-12-16 17:49:15.757553] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF50C-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1001, self="192.168.159.137:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=65, avg_log_submit_to_flush_time=4083, avg_log_submit_to_slide_time=5793) [2024-12-16 17:49:15.757686] INFO [PALF] read (log_cache.cpp:103) [129800][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:15.770601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=9) [2024-12-16 17:49:15.771548] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129964][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=9603) [2024-12-16 17:49:15.773090] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD78-0-0] [lt=11][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.773119] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD78-0-0] [lt=26][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.773135] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD78-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 17, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206C6F63616C2064617461, cstr: tenant local data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b864, hex: 72932F816D290600, int: 1734400155816818}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86c, hex: 72932F816D290600, int: 1734400155816818}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b874, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87c, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.773487] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD78-0-0] [lt=138][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.775796] INFO [PALF] read (log_cache.cpp:103) [129966][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=10193, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:15.776795] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128850][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD78-0-0] [lt=98] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:12872}, to_seq_no={branch:0, seq:4895}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484987} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.788141] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=20] worker thread began to shrink(tenant_->id()=1001, group_id_=1, token=0) [2024-12-16 17:49:15.789715] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [129969][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=39] LogLoopThread round_cost_time(us)(round_cost_time=92) [2024-12-16 17:49:15.789996] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=96] [PALF_DUMP](palf_id=1002, self="192.168.159.137:2882", [SlidingWindow]={palf_id:1002, self:"192.168.159.137:2882", lsn_allocator:{max_log_id:408412, max_lsn:49714606, max_scn:{val:1734400155411039003, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:49714606}, reserved_buffer_size:41943040, available_buffer_size:41943040, readable_begin_lsn:{lsn:7771566}}, last_submit_lsn:{lsn:49714484}, last_submit_end_lsn:{lsn:49714606}, last_submit_log_id:408412, last_submit_log_pid:1, max_flushed_lsn:{lsn:49714484}, max_flushed_end_lsn:{lsn:49714606}, max_flushed_log_pid:1, committed_end_lsn:{lsn:49714606}, last_slide_log_id:408412, last_slide_scn:{val:1734400155411039003, v:0}, last_slide_lsn:{lsn:49714484}, last_slide_end_lsn:{lsn:49714606}, last_slide_log_pid:1, last_slide_log_accum_checksum:1868959092, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x2b463a41a530}, [StateMgr]={this:0x2b463a41e830, self:"192.168.159.137:2882", palf_id:1002, role:"FOLLOWER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"192.168.159.138:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:408413, is_changing_config_with_arb:false, reconfirm_start_time_us:-1, palf_role_change_cb:0x2b463a425270, allow_vote:true}, [ConfigMgr]={palf_id:1002, self:"192.168.159.137:2882", alive_paxos_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, alive_paxos_replica_num:3, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:0, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"Invalid"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:9223372036854775807}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:9223372036854775807}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:9223372036854775807, config_seq:-1}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:1734400151866066, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:1734400151866066, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x2b463a41bc70}, [ModeMgr]={palf_id:1002, self:"192.168.159.137:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202110029000, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202110029000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202110029000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1002, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1734359202110029001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, log_sync_replica_num:3, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1734359202110029000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1734359202110029000, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1002}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1002/meta", dir_fd:180, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x2b463a4209f8, flashback_version:0}, log_storage:{log_tail:{lsn:49714606}, readable_log_tail:{lsn:49714606}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1734359202110029001, v:0}, curr_block_id:0, palf_id:1002}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1002/log", dir_fd:181, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:17390162, block_header_serialize_buf_:0x2b463a4226b8, flashback_version:0}, palf_epoch:3, last_purge_throttling_ts:-1, this:0x2b463a41ef70}, [Reconfirm]={palf_id:1002, self:"192.168.159.137:2882", state:"INITED", new_proposal_id:9223372036854775807, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:0, majority_max_log_server:"0.0.0.0:0", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:18446744073709551615}, saved_end_lsn:{lsn:18446744073709551615}, last_submit_prepare_req_time_us:-1, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x2b463a41e9b0}) [2024-12-16 17:49:15.790531] WDIAG [PALF] get_ack_info_array (log_sliding_window.cpp:2773) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=525][errcode=-4018] match_lsn_map_ get failed(ret=-4018, palf_id=1002, self="192.168.159.137:2882", tmp_server={server:"192.168.159.137:2882", timestamp:1, flag:0}) [2024-12-16 17:49:15.790563] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF_DUMP](palf_id=1002, self="192.168.159.137:2882", ack_info_list=[]) [2024-12-16 17:49:15.790585] WDIAG [PALF] get_ack_info_array (log_sliding_window.cpp:2773) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4018] match_lsn_map_ get failed(ret=-4018, palf_id=1002, self="192.168.159.137:2882", tmp_server={server:"192.168.159.137:2882", timestamp:1, flag:0}) [2024-12-16 17:49:15.790603] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=15] current log_task status(palf_id=1002, self="192.168.159.137:2882", log_id=408413, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[]) [2024-12-16 17:49:15.795295] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129283][T1001_L0_G1][T1001][Y0-0000000000000000-0-0] [lt=13] worker thread exit(tenant_->id()=1001, workers_.get_size()=5) [2024-12-16 17:49:15.795332] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129283][T1001_L0_G1][T0][Y0-0000000000000000-0-0] [lt=28] tenant thread end_run(id_=1001, ret=0, thread_count_=138) [2024-12-16 17:49:15.799465] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [129986][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-12-16 17:49:15.799912] INFO do_work (ob_rl_mgr.cpp:705) [128504][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-12-16 17:49:15.799919] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [129986][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=448] start lib cache evict(tenant_id=1001, mem_hold=48234496, mem_limit=53687090, cache_obj_num=128, cache_node_num=128) [2024-12-16 17:49:15.799943] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [129986][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=22] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=48234496, mem_limit=53687090, cache_obj_num=128, cache_node_num=128) [2024-12-16 17:49:15.799955] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [129986][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=11] schedule next cache evict task(evict_interval=5000000) [2024-12-16 17:49:15.802990] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [129986][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=8] Dumping All Cache Objs(alloc_obj_list.count()=128, alloc_obj_list=[{obj_id:458, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186431}, {obj_id:466, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199512}, {obj_id:646, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:1279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176058}, {obj_id:1282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175849}, {obj_id:1303, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174296}, {obj_id:1838, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187400}, {obj_id:1872, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:1876, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:1979, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:1995, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180155}, {obj_id:1999, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177156}, {obj_id:2005, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186126}, {obj_id:2010, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224753}, {obj_id:2018, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187787}, {obj_id:2022, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176380}, {obj_id:2023, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:2119, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:2140, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196344}, {obj_id:2150, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174864}, {obj_id:2153, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176824}, {obj_id:2154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182845}, {obj_id:2155, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182779}, {obj_id:2158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:2162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:2166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182367}, {obj_id:2246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175921}, {obj_id:2254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189506}, {obj_id:2334, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:2434, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182072}, {obj_id:2455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:2659, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198440}, {obj_id:2660, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175200}, {obj_id:2661, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:2662, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:2663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176770}, {obj_id:2664, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184116}, {obj_id:2665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185001}, {obj_id:2666, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:2667, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:2668, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:2669, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192098}, {obj_id:2670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195873}, {obj_id:2671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219724}, {obj_id:2672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186689}, {obj_id:2673, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200650}, {obj_id:2674, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196570}, {obj_id:2675, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:2676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:2677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:2678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:2679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177257}, {obj_id:2680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247811}, {obj_id:2681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174416}, {obj_id:2682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:2689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:2690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:2691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182449}, {obj_id:2692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177549}, {obj_id:2696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182228}, {obj_id:2697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193192}, {obj_id:2717, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189553}, {obj_id:2718, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183187}, {obj_id:2719, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260381}, {obj_id:2720, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229344}, {obj_id:2721, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304938}, {obj_id:2722, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:2723, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266152}, {obj_id:2756, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187637}, {obj_id:2757, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:2758, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207867}, {obj_id:2759, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:2760, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182784}, {obj_id:2761, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:2762, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181188}, {obj_id:2763, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:2764, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:2765, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:2766, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:2767, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:2768, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215656}, {obj_id:2769, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:2770, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:2771, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:2772, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:2773, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:2774, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:2775, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187484}, {obj_id:2776, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:2777, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174352}, {obj_id:2778, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175099}, {obj_id:2779, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209414}, {obj_id:2780, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231874}, {obj_id:2781, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:2782, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:2783, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:2784, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:2785, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226371}, {obj_id:2786, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205762}, {obj_id:2787, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:485263}, {obj_id:2788, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252317}, {obj_id:2789, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262030}, {obj_id:2790, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207544}, {obj_id:2791, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:2792, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189673}, {obj_id:2794, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235720}, {obj_id:2795, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173405}, {obj_id:2796, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175408}, {obj_id:2797, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278951}, {obj_id:2798, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176349}, {obj_id:2799, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300398}, {obj_id:2800, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259376}, {obj_id:2801, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199869}, {obj_id:2802, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238402}, {obj_id:2803, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182757}, {obj_id:2804, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180855}, {obj_id:2805, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217001}, {obj_id:2806, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:2807, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:2808, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178360}, {obj_id:2809, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202120}, {obj_id:2810, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:2811, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:2812, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268417}, {obj_id:2813, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263398}, {obj_id:2814, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:412995}, {obj_id:2815, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248272}, {obj_id:2816, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260654}]) [2024-12-16 17:49:15.803545] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [129986][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=550] schedule next cache evict task(evict_interval=5000000) [2024-12-16 17:49:15.804849] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [128751][T1_DBMSSched][T1][YB42C0A89F89-00062963E093C17E-0-0] [lt=8] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2024-12-16 17:49:15.805015] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629641F95ACC6-0-0] [lt=138][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=107970, send_timestamp=1734400155697043, peer="192.168.159.142:49916", sz=265) [2024-12-16 17:49:15.811355] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [128466][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=38] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=8728330240, fast_delete_log_mode=false) [2024-12-16 17:49:15.813068] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-0006296424B5A145-0-0] [lt=123][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=101298, send_timestamp=1734400155711767, peer="192.168.159.142:49904", sz=265) [2024-12-16 17:49:15.814491] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F89-00062963DE138F0B-0-0] [lt=34][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1472, fly_ts=101170, send_timestamp=1734400155713319, peer="192.168.159.142:50522", sz=377) [2024-12-16 17:49:15.814928] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-0006296423659F9C-0-0] [lt=22][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=112724, send_timestamp=1734400155702202, peer="192.168.159.142:49912", sz=265) [2024-12-16 17:49:15.822348] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [128633][T1_Occam][T1][YB42C0A89F89-00062963DE63DA83-0-0] [lt=71] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-12-16 17:49:15.822483] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [128633][T1_Occam][T1][YB42C0A89F89-00062963DE63DA85-0-0] [lt=30] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-12-16 17:49:15.823435] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [128786][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=104] start to print blacklist info [2024-12-16 17:49:15.823780] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [128786][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=33] ls blacklist refresh finish(cost_time=23596) [2024-12-16 17:49:15.830632] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7C-0-0] [lt=17][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.830723] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7C-0-0] [lt=87][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.830739] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7C-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206D6574612064617461, cstr: tenant meta data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: AD7D30816D290600, int: 1734400155876781}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: AD7D30816D290600, int: 1734400155876781}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.830926] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7C-0-0] [lt=111][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.832273] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD7C-0-0] [lt=43] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:1213}, to_seq_no={branch:0, seq:1208}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484989} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.833716] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.836831] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=59] ====== checkpoint timer task ====== [2024-12-16 17:49:15.836886] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get_max_applied_scn(scn={val:1734400155736065000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:382735365}, palf_committed_end_scn_:{val:1734400155819352000, v:0}, last_check_scn_:{val:1734400155819352000, v:0}, max_applied_cb_scn_:{val:1734400155736065000, v:0}}) [2024-12-16 17:49:15.836914] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1027) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1734358761251653, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x2b45adc11a30, log_storage_:{log_tail:{lsn:382735365}, readable_log_tail:{lsn:382735365}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:335523840}, min_scn:{val:1734393992693709001, v:0}, curr_block_id:5, palf_id:1}, block_mgr:{log_dir:"/ob/data/clog/tenant_1/1/log", dir_fd:160, min_block_id:0, max_block_id:6, curr_writable_block_id:5}, logical_block_size_:67104768, curr_block_writable_size_:19893243, block_header_serialize_buf_:0x2b45adc126b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:0, read_io_size:0, read_disk_cost_ts:0, start_lsn:{lsn:0}}}}}}) [2024-12-16 17:49:15.837903] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=76] succ to get rec scn(*this={this:0x2b45ade04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:2, v:0}, max_applied_start_working_ts_:{val:2, v:0}}, total_tx_ctx_count:1, active_tx_count:1, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1734358761043161, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-12-16 17:49:15.837941] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] tx ctx memtable get rec scn(this={ObITable:{this:0x2b45ac71c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x2b45ac71c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-12-16 17:49:15.838109] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=86] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1734358874250062001, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606846995}, rec_scn:{val:1734358874250062001, v:0}}, }, *this={this:0x2b45ac7bc510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734358874250062001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1734358851997684000, v:0}, all_id_meta:{id_meta:[{limited_id:1734400166652098000, latest_log_ts:{val:1734400150064877001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734366149163780001, v:0}}, {limited_id:30000001, latest_log_ts:{val:1734359848272073001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b459ab8e030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-12-16 17:49:15.838383] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=269] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="MDS_TABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x2b45ac7bc510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734358874250062001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1734358851997684000, v:0}, all_id_meta:{id_meta:[{limited_id:1734400166652098000, latest_log_ts:{val:1734400150064877001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734366149163780001, v:0}}, {limited_id:30000001, latest_log_ts:{val:1734359848272073001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b459ab8e030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}, min_rec_scn={val:1734358874250062001, v:0}, ls_id_={id:1}) [2024-12-16 17:49:15.838533] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=141] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-12-16 17:49:15.838592] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=55] get rec log scn(service_type_=0, rec_log_ts={val:1734400150064877001, v:0}) [2024-12-16 17:49:15.838601] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=9] get rec log scn(service_type_=1, rec_log_ts={val:1734366149163780001, v:0}) [2024-12-16 17:49:15.838609] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=6] get rec log scn(service_type_=2, rec_log_ts={val:1734359848272073001, v:0}) [2024-12-16 17:49:15.838765] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=5] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-12-16 17:49:15.838858] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=86] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-12-16 17:49:15.838876] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1734358874250062001, v:0}, checkpoint_scn_in_ls_meta={val:1734358874250062001, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-12-16 17:49:15.838956] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=11][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-12-16 17:49:15.838993] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-12-16 17:49:15.839049] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [128729][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=54] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-12-16 17:49:15.839080] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [129886][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=7] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-12-16 17:49:15.839103] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [129886][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=14] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-12-16 17:49:15.839113] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [129886][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=8] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-12-16 17:49:15.839120] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [129886][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=6] [tabletchange] task check ls(ls->get_ls_id()={id:1002}, tablet_persist_trigger=0) [2024-12-16 17:49:15.839127] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [129886][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=6] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=3, times=8200) [2024-12-16 17:49:15.851879] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7E-0-0] [lt=13][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.851920] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7E-0-0] [lt=36][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.851937] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7E-0-0] [lt=10][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420736C6F672064617461, cstr: tenant slog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: E2C930816D290600, int: 1734400155896290}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: E2C930816D290600, int: 1734400155896290}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.852084] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD7E-0-0] [lt=67][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.854569] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=34] worker thread began to shrink(tenant_->id()=1002, group_id_=1, token=0) [2024-12-16 17:49:15.855946] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129288][T1002_L0_G1][T1002][Y0-0000000000000000-0-0] [lt=121] worker thread exit(tenant_->id()=1002, workers_.get_size()=8) [2024-12-16 17:49:15.855978] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129288][T1002_L0_G1][T0][Y0-0000000000000000-0-0] [lt=25] tenant thread end_run(id_=1002, ret=0, thread_count_=202) [2024-12-16 17:49:15.868202] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD7E-0-0] [lt=34] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:20752}, to_seq_no={branch:0, seq:2797}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484990} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.875730] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [130000][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=25] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-12-16 17:49:15.877149] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [130000][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=29] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-12-16 17:49:15.877273] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [130000][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=19] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066816}, freeze_info_={latest_snapshot_gc_scn:{val:1734400151062280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066816}]}) [2024-12-16 17:49:15.890115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1434890240, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:15.890807] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128846][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD80-0-0] [lt=36][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.890852] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128846][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD80-0-0] [lt=41][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.890869] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128846][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD80-0-0] [lt=12][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b468de0bb90, local_datums:0x2b468de0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b468de0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b468de0b853, hex: 74656E616E7420736C6F672064617461, cstr: tenant slog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b863, hex: BA6331816D290600, int: 1734400155935674}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b86b, hex: BA6331816D290600, int: 1734400155935674}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b468de0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.890985] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128846][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD80-0-0] [lt=61][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.894598] INFO eloop_run (eloop.c:140) [128494][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1734400155894595, bytes: 0, bw: 0.000000 MB/s, add_ts: 1003788, add_bytes: 0 [2024-12-16 17:49:15.897189] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD80-0-0] [lt=165] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:2311}, to_seq_no={branch:0, seq:2306}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484991} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.908108] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [128669][T1_Occam][T1][YB42C0A89F89-00062963ED435926-0-0] [lt=26] ====== tenant freeze timer task ====== [2024-12-16 17:49:15.908840] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [128461][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=63] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=883343360, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=190398464, wash_ratio=6, tenant_id=1001) [2024-12-16 17:49:15.908919] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [128461][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=43] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-12-16 17:49:15.908968] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [128461][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=44] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=79401, drift_size_=0, pre_drift_size=-12600000, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-12-16 17:49:15.909033] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [128461][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=15] trace max work area(auto_calc=true, tenant_max_memory_limit=4294967296, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=214748364, max_wa_memory_size=214748364, tmp_max_wa_memory_size=214748364, pre_mem_target=214748364, remain_memory_size=214748364, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1451642880, washable_size=-2, max_workarea_memory_size=214748364, max_tenant_memory_size=2843324416, wash_ratio=6, tenant_id=1002) [2024-12-16 17:49:15.909135] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [128461][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=26843545, calc_global_bound_size=1048576000000, mem_target_=214748364, wa_max_memory_size=214748364, profile_cnt_=0, total_memory_size=0, max_wa_size=214748364, avg_bound_size=26843545, max_bound_size=26843545, min_bound_size_=1048576) [2024-12-16 17:49:15.909167] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [128461][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, global_bound_size_=26843545, manual_calc_cnt_=2, drift_size_=0, pre_drift_size=0, wa_max_memory_size=214748364, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=26843545, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=214748364, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-12-16 17:49:15.914531] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=68] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2024-12-16 17:49:15.914567] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] temporary file module use no blocks [2024-12-16 17:49:15.914577] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=9] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2024-12-16 17:49:15.914591] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1082) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=11] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2024-12-16 17:49:15.914603] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=12] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:168636473303, flush_io_finished_ret_:0, flush_io_finished_round_:40985, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2024-12-16 17:49:15.916397] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-0006296425B125B7-0-0] [lt=19][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=103332, send_timestamp=1734400155813062, peer="192.168.159.142:49916", sz=1623) [2024-12-16 17:49:15.916425] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [130042][T1001_TenantWea][T1001][YB42C0A89F89-00062963E5EC5356-0-0] [lt=103] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.156114959716796875e+01, this=0x2b45fe857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=357, Throttle Trigger(MB)=214, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.068143388453214129e+03) [2024-12-16 17:49:15.918149] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629641F012895-0-0] [lt=21][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=101310, send_timestamp=1734400155816837, peer="192.168.159.142:49912", sz=1554) [2024-12-16 17:49:15.919482] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [128568][TsMgr][T0][Y0-0000000000000000-0-0] [lt=12] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1734400155919470], gts:1734400155916319000, latest_srr:[mts=1734400155919470]}) [2024-12-16 17:49:15.920177] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-0006296424B5A146-0-0] [lt=17][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=108117, send_timestamp=1734400155812058, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:15.924003] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-0006296425B125B8-0-0] [lt=24][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=101152, send_timestamp=1734400155822847, peer="192.168.159.142:49904", sz=1556) [2024-12-16 17:49:15.925211] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [129813][T1002_BalanceEx][T1002][YB42C0A89F89-00062963EBF3F8BD-0-0] [lt=13] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-12-16 17:49:15.925369] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [129813][T1002_BalanceEx][T1002][YB42C0A89F89-00062963EBF3F8BD-0-0] [lt=153] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-12-16 17:49:15.933835] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:15.941383] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=269] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2024-12-16 17:49:15.941422] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=35] Construct Queue Num(construct_num=0, get_push_idx()=70, get_cur_idx()=62, get_pop_idx()=62) [2024-12-16 17:49:15.947293] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD84-0-0] [lt=12][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.947328] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD84-0-0] [lt=32][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.947344] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD84-0-0] [lt=9][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: E903000000000000, int: 1001}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206D6574612064617461, cstr: tenant meta data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: CB3632816D290600, int: 1734400155989707}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: CB3632816D290600, int: 1734400155989707}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.947471] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD84-0-0] [lt=64][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.949072] INFO [COMMON] process (ob_rpc_processor_simple.cpp:2755) [129142][T1001_L0_G19][T1001][YB42C0A89F8A-00062963E6E96A71-0-0] [lt=27] handle ObQueryLSIsValidMember requeset(arg_={tenant_id_:1001, self_addr_:"192.168.159.138:2882", ls_array_:[{id:1}]}) [2024-12-16 17:49:15.949122] INFO [CLOG] get_member_gc_stat (ob_log_handler.cpp:1619) [129142][T1001_L0_G19][T1001][YB42C0A89F8A-00062963E6E96A71-0-0] [lt=42] get_member_gc_stat(is_valid_member=true, stat=1, member_list=3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, learner_list={learner_num:0, learner_array:[]}, addr="192.168.159.138:2882", this={role:1, proposal_id:1, palf_env_:0x2b46037aa030, is_in_stop_state_:false, is_inited_:true, id_:1}) [2024-12-16 17:49:15.951250] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD84-0-0] [lt=56] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:12751}, to_seq_no={branch:0, seq:6}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484993} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.960272] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128785][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD85-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1734400155959170000, start_id=1734400155959170000, end_id=1734400155959170001) [2024-12-16 17:49:15.967692] INFO [PALF] read (log_cache.cpp:103) [129849][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=114] [PALF STAT HOT CACHE HIT RATE](palf_id=1002, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:15.972118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=138] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=8) [2024-12-16 17:49:15.973983] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [128713][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-12-16 17:49:15.974071] WDIAG read_multi_row (ob_table_access_helper.h:238) [128713][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=24][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-12-16 17:49:15.974594] INFO [SHARE] create_user_ls (ob_ls_creator.cpp:167) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=31] start to create log stream(id={id:1003}, tenant_id=1002) [2024-12-16 17:49:15.975380] INFO delete_row (ob_table_access_helper.h:312) [128713][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=16] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1734400155974089) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1734400155974089) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2024-12-16 17:49:15.983422] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD86-0-0] [lt=12][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:15.983484] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD86-0-0] [lt=57][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:15.983507] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD86-0-0] [lt=16][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E74206D6574612064617461, cstr: tenant meta data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b863, hex: B0A632816D290600, int: 1734400156018352}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86b, hex: B0A632816D290600, int: 1734400156018352}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b873, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87b, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:15.983794] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD86-0-0] [lt=70][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:15.987847] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [129882][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=91] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1734400155411039002, v:0}, new_max_version={val:1734400155411039002, v:0}, last_min_version={val:1734400155181199000, v:0}, last_max_version={val:1734400155181199000, v:0}, total_time_us=18084, delta_us=576805) [2024-12-16 17:49:15.987888] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [129882][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1734400155411039002, v:0}, min_version={val:1734400155411039002, v:0}, max_version={val:1734400155411039002, v:0}, in_service=true, leader_epoch=1) [2024-12-16 17:49:15.988811] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=29] worker thread began to shrink(tenant_->id()=1002, group_id_=18, token=0) [2024-12-16 17:49:15.989345] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128852][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD86-0-0] [lt=42] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:17638}, to_seq_no={branch:0, seq:1465}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484994} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:15.990927] INFO [PALF] check_parent_health (log_config_mgr.cpp:2820) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=130] re_register_parent reason(palf_id=1002, self="192.168.159.137:2882", is_registering_timeout=true, first_registration=false, parent_timeout=false, parent_keepalive_time_us=-1, last_submit_register_req_time_us=1734400151866066, last_first_register_time_us=1734359218853777, register_time_us=1734400151866066, curr_time_us=1734400155990922) [2024-12-16 17:49:15.991078] INFO [PALF] register_parent_ (log_config_mgr.cpp:2667) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=106] register_parent_(ret=0, ret="OB_SUCCESS", palf_id=1002, self="192.168.159.137:2882", reason=1, leader="192.168.159.138:2882", register_time_us=1734400155991035, last_submit_register_req_time_us=1734400155991035, register_parent_reason=1) [2024-12-16 17:49:15.991105] INFO [PALF] check_parent_health (log_config_mgr.cpp:2829) [129803][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=26] re register_parent success(ret=0, ret="OB_SUCCESS", palf_id=1002, self="192.168.159.137:2882") [2024-12-16 17:49:15.994025] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129083][T1002_L0_G18][T1002][Y0-0000000000000000-0-0] [lt=27] worker thread exit(tenant_->id()=1002, workers_.get_size()=1) [2024-12-16 17:49:15.994093] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129083][T1002_L0_G18][T0][Y0-0000000000000000-0-0] [lt=56] tenant thread end_run(id_=1002, ret=0, thread_count_=201) [2024-12-16 17:49:15.999880] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:143718363}], scn_array=[cnt:1, {val:1734400155982532000, v:0}], curr_size=1333, accum_size=3002, time_cost=10829) [2024-12-16 17:49:16.000604] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=12][errcode=-4152] get int failed(name="major_refresh_mv_merge_scn", ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:16.000727] WDIAG [SHARE] get_major_refresh_mv_merge_scn (ob_global_stat_proxy.cpp:329) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=120][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:16.000742] INFO [SHARE] check_tenant_mv_merge_info_ (ob_ls_creator.cpp:460) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=13] create ls with merge info(ret=0, ret="OB_SUCCESS", major_mv_merge_info={major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:16.001803] INFO [STORAGE] create_ls (ob_ls_service.cpp:500) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=23] create_ls begin(arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:16.001984] WDIAG [STORAGE] get_ls (ob_ls_service.cpp:977) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=174][errcode=-4719] get log stream fail(ret=-4719, ls_id={id:1003}) [2024-12-16 17:49:16.002012] WDIAG [STORAGE] check_tenant_ls_num_ (ob_ls_service.cpp:404) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=16][errcode=-4720] too many ls of a tenant(ret=-4720, normal_ls_count=3, removeing_ls_count=0, min_constraint_type=5, get_constraint_type_name(min_constraint_type)="clog_disk", min_constraint_value=3) [2024-12-16 17:49:16.002099] WDIAG [STORAGE] create_ls_ (ob_ls_service.cpp:1287) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=71][errcode=-4720] too many ls(ret=-4720) [2024-12-16 17:49:16.002110] WDIAG [STORAGE] create_ls (ob_ls_service.cpp:525) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=10][errcode=-4720] create ls failed(ret=-4720, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:16.002137] INFO [STORAGE] create_ls (ob_ls_service.cpp:533) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=26] create_ls finish(ret=-4720, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:16.002159] WDIAG [COMMON] process (ob_rpc_processor_simple.cpp:1596) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F403-0-0] [lt=20][errcode=-4720] failed create log stream(ret=-4720, ret="OB_TOO_MANY_TENANT_LS", arg_=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:16.007374] WDIAG [RPC] wait (ob_async_rpc_proxy.h:453) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=14][errcode=0] execute rpc failed(rc=-4720, server="192.168.159.137:2882", timeout=29982799, packet code=2338, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}, ret=0) [2024-12-16 17:49:16.007433] WDIAG [RPC] wait (ob_async_rpc_proxy.h:453) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=53][errcode=0] execute rpc failed(rc=-4720, server="192.168.159.138:2882", timeout=29982757, packet code=2338, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}, ret=0) [2024-12-16 17:49:16.007544] WDIAG [RPC] wait (ob_async_rpc_proxy.h:453) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=109][errcode=0] execute rpc failed(rc=-4720, server="192.168.159.139:2882", timeout=29982734, packet code=2338, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}, ret=0) [2024-12-16 17:49:16.007723] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:681) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=174][errcode=0] rpc is failed(ret=0, ret="OB_SUCCESS", return_code_array.at(i)=-4720, i=0) [2024-12-16 17:49:16.007736] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:681) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=13][errcode=0] rpc is failed(ret=0, ret="OB_SUCCESS", return_code_array.at(i)=-4720, i=1) [2024-12-16 17:49:16.007743] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:681) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=7][errcode=0] rpc is failed(ret=0, ret="OB_SUCCESS", return_code_array.at(i)=-4720, i=2) [2024-12-16 17:49:16.007751] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:733) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=6][errcode=-4672] success count less than majority(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", paxos_replica_num=3, member_list=0) [2024-12-16 17:49:16.007960] INFO [SHARE] add_event (ob_event_history_table_operator.h:266) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=65] event table add task(ret=0, event_table_name="__all_rootservice_event_history", sql=INSERT INTO __all_rootservice_event_history (gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, rs_svr_ip, rs_svr_port) VALUES (usec_to_time(1734400156007819), 'LS', 'create_ls', 'tenant_id', 1002, 'ls_id', '{id:1003}', 'ret', -4672, 'success_cnt', '0', 'paxos_cnt', 3, '', 0, X'74726163655F69643A5942343243304138394638392D303030363239363345433133463430332D302D30', '192.168.159.137', 2882)) [2024-12-16 17:49:16.007976] WDIAG [SHARE] create_ls_ (ob_ls_creator.cpp:554) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=15][errcode=-4672] failed to check ls result(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", paxos_replica_num=3, return_code_array=[-4720, -4720, -4720], learner_list={learner_num:0, learner_array:[]}, need_create_arb_replica=false, arb_replica_count=0) [2024-12-16 17:49:16.007993] WDIAG [SHARE] do_create_ls_ (ob_ls_creator.cpp:383) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=14][errcode=-4672] failed to create log stream(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", id={id:1003}, tenant_id=1002, create_with_palf=false, addr=[{addr:"192.168.159.137:2882", replica_type:0}, {addr:"192.168.159.138:2882", replica_type:0}, {addr:"192.168.159.139:2882", replica_type:0}], paxos_replica_num=3, tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400153908143004, replayable_scn:1734400153908143004, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn={val:1734359202119679000, v:0}, compat_mode=0, palf_base_info={prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, learner_list={learner_num:0, learner_array:[]}) [2024-12-16 17:49:16.008028] WDIAG [SHARE] create_user_ls (ob_ls_creator.cpp:219) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=32][errcode=-4672] failed to create log stream(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", id={id:1003}, tenant_id=1002, addr=[{addr:"192.168.159.137:2882", replica_type:0}, {addr:"192.168.159.138:2882", replica_type:0}, {addr:"192.168.159.139:2882", replica_type:0}], paxos_replica_num=3, status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"CREATING", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, create_scn={val:1734359202119679000, v:0}, palf_base_info={prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}) [2024-12-16 17:49:16.008124] INFO [SHARE] create_user_ls (ob_ls_creator.cpp:223) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=91] finish to create log stream(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", id={id:1003}, tenant_id=1002, cost=33529) [2024-12-16 17:49:16.008234] INFO [SHARE] add_event (ob_event_history_table_operator.h:266) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F403-0-0] [lt=10] event table add task(ret=0, event_table_name="__all_rootservice_event_history", sql=INSERT INTO __all_rootservice_event_history (gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, rs_svr_ip, rs_svr_port) VALUES (usec_to_time(1734400156008137), 'LS', 'create_ls_finish', 'tenant_id', 1002, 'ls_id', '{id:1003}', 'ret', -4672, 'success_cnt', '', 'paxos_cnt', 3, '', 0, X'636F73743A33333532392C2074726163655F69643A5942343243304138394638392D303030363239363345433133463430332D302D30', '192.168.159.137', 2882)) [2024-12-16 17:49:16.014989] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1734400155916319000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1734400156014941}, version_delta=98668) [2024-12-16 17:49:16.017291] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=48][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:382738783}], scn_array=[cnt:1, {val:1734400156005679000, v:0}], curr_size=562, accum_size=14756, time_cost=10503) [2024-12-16 17:49:16.024580] WDIAG [STORAGE.TRANS] lock_row_on_frozen_stores_ (ob_memtable.cpp:1328) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD88-0-0] [lt=18][errcode=-5024] internal lock row failed(ret=-5024, ret="OB_ERR_PRIMARY_KEY_DUPLICATE") [2024-12-16 17:49:16.024615] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4635) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD88-0-0] [lt=31][errcode=-5024] fail to set memtable(ret=-5024) [2024-12-16 17:49:16.024718] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5696) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD88-0-0] [lt=96][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x2b4671e0bb90, local_datums:0x2b4671e0bb90}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b82c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b834, hex: 3139322E3136382E3135392E313433, cstr: 192.168.159.143}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b843, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b84b, hex: 0600000000000000, int: 6}, col_id=4:{len: 15, flag: 0, null: 0, ptr: 0x2b4671e0b853, hex: 74656E616E7420746D702064617461, cstr: tenant tmp data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b862, hex: 4A6F33816D290600, int: 1734400156069706}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b86a, hex: 4A6F33816D290600, int: 1734400156069706}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b872, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x2b4671e0b87a, hex: 0000000000000000, int: 0}]}) [2024-12-16 17:49:16.024850] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [128769][T1_L5_G0][T1][YB42C0A89F8F-000629642E4CAD88-0-0] [lt=64][errcode=-5024] failed to write row(ret=-5024) [2024-12-16 17:49:16.027547] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [129930][T1002_L5_G0][T1002][YB42C0A89F8D-0006296421389954-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1734400156025278000, start_id=1734400156025278000, end_id=1734400156025278001) [2024-12-16 17:49:16.028592] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [128851][T1_L0_G0][T1][YB42C0A89F8F-000629642E4CAD88-0-0] [lt=42] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:14834}, to_seq_no={branch:0, seq:5}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1734358803354512 max_table_version=1734358803354512 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:484995} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-12-16 17:49:16.033922] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=111][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.041359] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-0006296425C043C4-0-0] [lt=21][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=100898, send_timestamp=1734400155940457, peer="192.168.159.142:50522", sz=1659) [2024-12-16 17:49:16.052413] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128571][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.053889] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128572][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.054387] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [129788][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=61] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}, {1002,1,False,{False,},False,False,True}, {1003,1,False,{False,},False,False,True}]) [2024-12-16 17:49:16.055826] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x2b46342ef470, extra_info="") [2024-12-16 17:49:16.055983] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=90] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x2b46342d1410, extra_info="id:1001") [2024-12-16 17:49:16.056209] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128569][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.056297] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128570][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.057949] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="192.168.159.137:2882", committed size=1098) [2024-12-16 17:49:16.064995] INFO [LIB] stat (utility.h:1176) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF519-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x2b46342ef6a0, extra_info="palf_id:1001") [2024-12-16 17:49:16.065062] INFO [LIB] stat (utility.h:1176) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF519-0-0] [lt=64] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6155, this=0x2b46342ef8d0, extra_info="palf_id:1001") [2024-12-16 17:49:16.065187] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF518-0-0] [lt=63] [PALF STAT LOG TASK TIME](palf_id=1002, self="192.168.159.137:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=0, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=2267, avg_log_submit_to_slide_time=4635) [2024-12-16 17:49:16.065347] INFO [PALF] next (palf_iterator.h:183) [129913][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT ITERATOR INFO](io_ctx={user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:407618, miss_cnt:0, cache_read_size:49714963, hit_ratio:"1.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:0, read_io_size:0, read_disk_cost_ts:0, start_lsn:{lsn:0}}}) [2024-12-16 17:49:16.072083] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [130229][T1002_L0_G5][T1002][YB42C0A89F8F-000629642B3FD737-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1734400156071597000, start_id=1734400156071597000, end_id=1734400156071597001) [2024-12-16 17:49:16.091408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1434890240, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:16.091918] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629641FA3C0C8-0-0] [lt=22][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=101381, send_timestamp=1734400155990495, peer="192.168.159.142:49916", sz=239) [2024-12-16 17:49:16.094211] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629641FA3C0C9-0-0] [lt=23][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=101284, send_timestamp=1734400155992925, peer="192.168.159.142:49912", sz=240) [2024-12-16 17:49:16.095987] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641FA3C0CA-0-0] [lt=31][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100313, send_timestamp=1734400155995672, peer="192.168.159.142:49904", sz=240) [2024-12-16 17:49:16.116968] INFO [LIB] stat (utility.h:1176) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=78, this=0x2b460dff1470, extra_info="") [2024-12-16 17:49:16.117098] INFO [LIB] stat (utility.h:1176) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=95] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x2b460dfad410, extra_info="id:1") [2024-12-16 17:49:16.117654] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3754) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2024-12-16 17:49:16.117741] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3777) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=85] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2024-12-16 17:49:16.119831] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129287][T1001_L0_G1][T1001][YB42C0A89F8A-00062963E9CCB08D-0-0] [lt=97] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="192.168.159.137:2882", committed size=9647) [2024-12-16 17:49:16.127266] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [128649][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=40] LogLoopThread round_cost_time(us)(round_cost_time=16) [2024-12-16 17:49:16.134128] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.142755] INFO [LIB] stat (utility.h:1176) [128728][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=33, stat_interval=1000000, avg (count/cost)=0, this=0x2b45ac7c5410, extra_info="id:1") [2024-12-16 17:49:16.145456] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=32212254, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=14558208) [2024-12-16 17:49:16.145507] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=73, get_cur_idx()=65, get_pop_idx()=65) [2024-12-16 17:49:16.145839] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [129888][T1002_LSArchive][T1002][YB42C0A89F89-00062963E5535926-0-0] [lt=45] gc stale ls task succ [2024-12-16 17:49:16.146711] INFO [LIB] stat (utility.h:1176) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=34, stat_interval=1000000, avg (count/cost)=1714, this=0x2b45adc15bb0, extra_info="palf_id:1") [2024-12-16 17:49:16.146764] INFO [LIB] stat (utility.h:1193) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=34, stat_interval=1000000, avg (count/cost)=280, this=0x2b459aa9d370, extra_info="") [2024-12-16 17:49:16.146860] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [128643][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="192.168.159.137:2882", committed size=19564) [2024-12-16 17:49:16.146895] INFO [LIB] stat (utility.h:1176) [128643][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=34, stat_interval=1000000, avg (count/cost)=21, this=0x2b45adc15de0, extra_info="palf_id:1") [2024-12-16 17:49:16.147211] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129289][T1_L0_G1][T1][YB42C0A89F8A-00062963E9EBC064-0-0] [lt=141] [PALF STAT LOG TASK TIME](palf_id=1, self="192.168.159.137:2882", total_slide_log_cnt=34, avg_log_gen_to_freeze_time=229, avg_log_gen_to_submit_time=331, avg_log_submit_to_flush_time=2038, avg_log_submit_to_slide_time=4221) [2024-12-16 17:49:16.147948] INFO [PALF] read (log_cache.cpp:103) [128646][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=20149, hit_cnt=34, read_cnt=34, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:16.155908] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=71, this=0x2b461f6c3470, extra_info="") [2024-12-16 17:49:16.155947] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=4338, avg_group_log_size=333) [2024-12-16 17:49:16.155966] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, append size=4338) [2024-12-16 17:49:16.155980] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x2b461f671410, extra_info="id:1") [2024-12-16 17:49:16.157696] INFO [LIB] stat (utility.h:1176) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2852, this=0x2b461f6cdbb0, extra_info="palf_id:1") [2024-12-16 17:49:16.157723] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=4216) [2024-12-16 17:49:16.157739] INFO [LIB] stat (utility.h:1193) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=546, this=0x2b45db5f8530, extra_info="") [2024-12-16 17:49:16.157761] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=118] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="192.168.159.137:2882", committed size=4216) [2024-12-16 17:49:16.157778] INFO [LIB] stat (utility.h:1176) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=13, this=0x2b461f6cdde0, extra_info="palf_id:1") [2024-12-16 17:49:16.161581] INFO [LIB] stat (utility.h:1176) [129240][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF51A-0-0] [lt=9] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=9, this=0x2b461f6c36a0, extra_info="palf_id:1") [2024-12-16 17:49:16.161721] INFO [LIB] stat (utility.h:1176) [129240][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF51A-0-0] [lt=137] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5407, this=0x2b461f6c38d0, extra_info="palf_id:1") [2024-12-16 17:49:16.161817] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129240][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF51A-0-0] [lt=94] [PALF STAT LOG TASK TIME](palf_id=1, self="192.168.159.137:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=88, avg_log_submit_to_flush_time=3351, avg_log_submit_to_slide_time=5319) [2024-12-16 17:49:16.161964] INFO [PALF] read (log_cache.cpp:103) [129800][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4338, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:16.162314] INFO [LIB] stat (utility.h:1176) [129275][T1002_L0_G1][T1002][YB42C0A89F8A-00062963E9BEECF5-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x2b463a41b470, extra_info="") [2024-12-16 17:49:16.163874] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129797][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1002, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=1211) [2024-12-16 17:49:16.165416] INFO [LIB] stat (utility.h:1176) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF51B-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x2b463a41b6a0, extra_info="palf_id:1002") [2024-12-16 17:49:16.165546] INFO [LIB] stat (utility.h:1176) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF51B-0-0] [lt=127] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4851, this=0x2b463a41b8d0, extra_info="palf_id:1002") [2024-12-16 17:49:16.172222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=7) [2024-12-16 17:49:16.175603] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=11] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=103079214, evict_high_size_level=530841, evict_batch_count=0, elapse_time=0, size_used=65536, mem_used=97747968) [2024-12-16 17:49:16.175692] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=84] Construct Queue Num(construct_num=0, get_push_idx()=29, get_cur_idx()=21, get_pop_idx()=20) [2024-12-16 17:49:16.179263] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [129882][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1734359175576531, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-12-16 17:49:16.188409] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [130048][T1001_LSArchive][T1001][YB42C0A89F89-00062963E5F35926-0-0] [lt=124] gc stale ls task succ [2024-12-16 17:49:16.204553] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-0006296423659FA0-0-0] [lt=25][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=101864, send_timestamp=1734400156102686, peer="192.168.159.142:49904", sz=265) [2024-12-16 17:49:16.204795] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [128744][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-12-16 17:49:16.211981] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [128734][T1_LSArchiveMgr][T1][YB42C0A89F89-00062963DDB35926-0-0] [lt=46] gc stale ls task succ [2024-12-16 17:49:16.215504] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-0006296424B5A148-0-0] [lt=28][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=103126, send_timestamp=1734400156112374, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:16.234315] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.258967] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [129275][T1002_L0_G1][T1002][YB42C0A89F8A-00062963E9BEECF7-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1002, self="192.168.159.137:2882", role="FOLLOWER", total_group_log_cnt=10, avg_log_batch_cnt=0, total_group_log_size=1211, avg_group_log_size=121) [2024-12-16 17:49:16.259003] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129275][T1002_L0_G1][T1002][YB42C0A89F8A-00062963E9BEECF7-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1002, self="192.168.159.137:2882", committed size=1211) [2024-12-16 17:49:16.262090] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [128689][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=111] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:939, free_obj_hold_cnt:136, allocator used:4136600, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:136, free_obj_hold_cnt:5, allocator used:9248331, allocator total:9248331}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():190464, full allocator used:1600, full allocator total:256000}, tablets_mem=13943371, tablets_mem_limit=429496720, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:28, free_obj_hold_cnt:116, allocator used:294912, allocator total:326400}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2024-12-16 17:49:16.263016] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [130045][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=52] ====== check clog disk timer task ====== [2024-12-16 17:49:16.263045] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [130045][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=512, used(MB):=398) [2024-12-16 17:49:16.265674] INFO [LIB] stat (utility.h:1176) [129910][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=23] [REPLAY STAT REPLAY TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=226, this=0x2b45f40048f8, extra_info="") [2024-12-16 17:49:16.265703] INFO [LIB] stat (utility.h:1176) [129910][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=29] [REPLAY STAT REPLAY TASK EXECUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x2b45f4004b28, extra_info="") [2024-12-16 17:49:16.268258] INFO [SHARE] pre_run (ob_tenant_base.cpp:319) [129291][][T1002][Y0-0000000000000000-0-0] [lt=0] tenant thread pre_run(MTL_ID()=1002, ret=0, thread_count_=202) [2024-12-16 17:49:16.268302] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [129291][][T1002][Y0-0000000000000000-0-0] [lt=41] Init thread local success [2024-12-16 17:49:16.268341] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [129291][T1002_L0_G18][T1002][YB42C0A89F8A-00062963E389E620-0-0] [lt=11] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1002}, all_replica:false}) [2024-12-16 17:49:16.268373] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [129291][T1002_L0_G18][T1002][YB42C0A89F8A-00062963E389E620-0-0] [lt=14] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1734400155907978003, v:0}, arg={tenant_id:1002, ls_id:{id:1002}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1002}, cur_readable_scn:{val:1734400155907978003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"192.168.159.137:2882"}, offline_scn={val:18446744073709551615, v:3}) [2024-12-16 17:49:16.268425] INFO [SERVER.OMT] recv_group_request (ob_tenant.cpp:1418) [128490][pnio1][T0][YB42C0A89F8A-00062963E389E620-0-0] [lt=25] worker thread created(id()=1002, group->group_id_=18) [2024-12-16 17:49:16.269923] INFO [LIB] stat (utility.h:1176) [128745][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=33, stat_interval=1000000, avg (count/cost)=86, this=0x2b45adc0b470, extra_info="") [2024-12-16 17:49:16.269953] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [128745][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=33, avg_log_batch_cnt=1, total_group_log_size=19564, avg_group_log_size=592) [2024-12-16 17:49:16.269970] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [128745][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, append size=19564) [2024-12-16 17:49:16.273725] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [128574][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.273990] INFO [LIB] stat (utility.h:1176) [129289][T1_L0_G1][T1][YB42C0A89F8A-00062963E9EBC065-0-0] [lt=57] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=33, stat_interval=1000000, avg (count/cost)=18, this=0x2b45adc0b6a0, extra_info="palf_id:1") [2024-12-16 17:49:16.274027] INFO [LIB] stat (utility.h:1176) [129289][T1_L0_G1][T1][YB42C0A89F8A-00062963E9EBC065-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=33, stat_interval=1000000, avg (count/cost)=4464, this=0x2b45adc0b8d0, extra_info="palf_id:1") [2024-12-16 17:49:16.274840] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [128581][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.274872] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [128583][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.274892] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [128585][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.275926] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128587][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.276001] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [128578][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.276162] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [128575][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.276192] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [128582][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.276211] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [128580][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.276235] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [128577][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.276258] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [128576][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:16.292256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1428598784, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:16.298345] INFO pn_ratelimit (group.c:626) [128595][IngressService][T0][Y0-0000000000000000-0-0] [lt=29] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-12-16 17:49:16.299015] INFO [STORAGE.TRANS] statistics_ (ob_trans_rpc.cpp:678) [130013][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=31] rpc statistics(total_trans_msg_count=1, total_batch_msg_count=0) [2024-12-16 17:49:16.303085] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629642570BF67-0-0] [lt=15][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=100806, send_timestamp=1734400156202275, peer="192.168.159.142:49916", sz=1579) [2024-12-16 17:49:16.305782] WDIAG [STORAGE] inner_table_scan (ob_ls_tablet_service.cpp:2364) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=91][errcode=-4012] table scan timeout(ret=-4012, current_time=1734400156302404, table_scan_param_timeout=1734400156233659, lbt()="0x7bcec65 0x15d7fea2 0x7551ac0 0x754fc86 0x7549b0d 0x7547aac 0x7547030 0x7545d65 0x7543f55 0x752f1a0 0x7529e91 0x75289f8 0x108a99b9 0x108ab937 0x108aa665 0x7be5a58 0x74c49cc 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d") [2024-12-16 17:49:16.305812] WDIAG [STORAGE] inner_table_scan (ob_ls_tablet_service.cpp:2378) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=29][errcode=-4012] failed to do table scan(ret=-4012, param={tablet_id:{id:413}, ls_id:{id:1}, column_ids:[18, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29], index_id:413, key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"NULL":"NULL"};{"BIGINT UNSIGNED":0})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":0};{"BIGINT UNSIGNED":70000000})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":2000000000};MAX)"}], ss_key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}], range_array_pos:[], timeout:1734400156233659, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:1, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, reserved:0}, sql_mode:4194304, reserved_cell_count:14, schema_version:1734358805566592, query_begin_schema_version:-1, limit_offset:{offset_:0, limit_:-1}, for_update:false, wait:-1, frozen_version:-1, is_get:false, output_exprs:[cnt:14, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:0, res_buf_off:8603, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7171, pvt_skip_off:192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5564, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac080}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:200, res_buf_off:8731, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7179, pvt_skip_off:392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5629, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac168}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:400, res_buf_off:8859, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7187, pvt_skip_off:592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5694, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac250}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:600, res_buf_off:8987, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7195, pvt_skip_off:792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5759, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac338}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:800, res_buf_off:9115, dyn_buf_header_offset:7323, res_buf_len:128, eval_flags_off:7203, pvt_skip_off:992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5824, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac420}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1000, res_buf_off:11163, dyn_buf_header_offset:7579, res_buf_len:128, eval_flags_off:7211, pvt_skip_off:1192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5889, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac508}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1200, res_buf_off:13211, dyn_buf_header_offset:7835, res_buf_len:8, eval_flags_off:7219, pvt_skip_off:1392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5954, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac5f0}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1400, res_buf_off:13339, dyn_buf_header_offset:7835, res_buf_len:128, eval_flags_off:7227, pvt_skip_off:1592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6019, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac6d8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1600, res_buf_off:15387, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7235, pvt_skip_off:1792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6084, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac7c0}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1800, res_buf_off:16027, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7243, pvt_skip_off:1992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6149, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac8a8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2000, res_buf_off:16667, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7251, pvt_skip_off:2192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6214, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac990}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2200, res_buf_off:17307, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7259, pvt_skip_off:2392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6279, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7aca78}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2400, res_buf_off:17947, dyn_buf_header_offset:8091, res_buf_len:128, eval_flags_off:7267, pvt_skip_off:2592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6344, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acb60}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2600, res_buf_off:19995, dyn_buf_header_offset:8347, res_buf_len:128, eval_flags_off:7275, pvt_skip_off:2792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6409, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acc48}], op_filters:NULL, trans_desc:NULL, snapshot:{this:0x2b4681014148, valid:true, source:2, core:{version:{val:1734400156139063000, v:0}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:1}, snapshot_ls_role:1, snapshot_acquire_addr:"192.168.159.137:2882", parts:[], committed:false}, table_param:{table_id:413, output_projector:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], aggregate_projector:[cnt:0], group_by_projector:[cnt:0], output_sel_mask:[cnt:14, true, true, true, true, true, true, true, true, true, true, true, true, true, true], pad_col_projector:[cnt:0], read_param_version:1, main_read_info:{schema_column_count:14, schema_rowkey_cnt:1, rowkey_cnt:3, trans_col_index:-1, mview_old_new_col_index:-1, group_idx_col_index:-1, seq_read_column_count:1, max_col_index:15, is_oracle_mode:false, cols_index:{rowkey_mode:false, for_memtable:false, array:{ObIArray:[cnt:14, 0, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15], data:0x2b45bb7b07a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, memtable_cols_index:{rowkey_mode:false, for_memtable:true, array:{ObIArray:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], data:0x2b45bb7b07e0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, cols_desc:{ObIArray:[cnt:14, column_id=18 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=24 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=25 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=26 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=27 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=28 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=29 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0], data:0x2b45bb7b06f0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, cg_idxs:{ObIArray:[cnt:0], data:null, count:0, allocator:null, capacity:0, init_cnt:0}, cols_extend:{ObIArray:[cnt:14, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}], data:0x2b45bb7b08a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, has_all_column_group:true, datum_utils:{is_oracle_mode:false, rowkey_cnt:3, is_inited:true, is_oracle_mode:false}, cols_param:[{column_id:18, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:16, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:17, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:19, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:20, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:128, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:21, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:256, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:22, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:23, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:4096, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:24, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:25, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:26, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:27, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:28, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:29, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}]}, use_lob_locator:false, rowid_version:0, rowid_projector:[cnt:0], enable_lob_locator_v2:true, is_fts_index:false, parser_name:"", is_vec_index:false, is_column_replica_table:false}, sample_info:{method:0, percent:"1.000000000000000000e+02", seed:-1, table_id:0, scope:0, force_block:false}, need_scn:false, need_switch_param:false, is_mds_query:false, fb_read_tx_uncommitted:false, external_file_format:{"TYPE":"INVALID"}, external_file_location:"", tx_seq_base:1734400156357521}, *this={ObIRoleChangeSubHandler:"Dummy"}, data_max_schema_version=0) [2024-12-16 17:49:16.306310] WDIAG [STORAGE] table_scan (ob_ls_tablet_service.cpp:673) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=495][errcode=-4012] failed to do table scan(ret=-4012, &iter=0x2b45982260d0, param={tablet_id:{id:413}, ls_id:{id:1}, column_ids:[18, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29], index_id:413, key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"NULL":"NULL"};{"BIGINT UNSIGNED":0})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":0};{"BIGINT UNSIGNED":70000000})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":2000000000};MAX)"}], ss_key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}], range_array_pos:[], timeout:1734400156233659, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:1, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, reserved:0}, sql_mode:4194304, reserved_cell_count:14, schema_version:1734358805566592, query_begin_schema_version:-1, limit_offset:{offset_:0, limit_:-1}, for_update:false, wait:-1, frozen_version:-1, is_get:false, output_exprs:[cnt:14, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:0, res_buf_off:8603, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7171, pvt_skip_off:192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5564, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac080}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:200, res_buf_off:8731, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7179, pvt_skip_off:392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5629, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac168}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:400, res_buf_off:8859, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7187, pvt_skip_off:592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5694, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac250}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:600, res_buf_off:8987, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7195, pvt_skip_off:792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5759, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac338}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:800, res_buf_off:9115, dyn_buf_header_offset:7323, res_buf_len:128, eval_flags_off:7203, pvt_skip_off:992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5824, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac420}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1000, res_buf_off:11163, dyn_buf_header_offset:7579, res_buf_len:128, eval_flags_off:7211, pvt_skip_off:1192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5889, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac508}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1200, res_buf_off:13211, dyn_buf_header_offset:7835, res_buf_len:8, eval_flags_off:7219, pvt_skip_off:1392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5954, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac5f0}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1400, res_buf_off:13339, dyn_buf_header_offset:7835, res_buf_len:128, eval_flags_off:7227, pvt_skip_off:1592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6019, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac6d8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1600, res_buf_off:15387, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7235, pvt_skip_off:1792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6084, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac7c0}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1800, res_buf_off:16027, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7243, pvt_skip_off:1992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6149, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac8a8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2000, res_buf_off:16667, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7251, pvt_skip_off:2192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6214, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac990}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2200, res_buf_off:17307, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7259, pvt_skip_off:2392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6279, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7aca78}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2400, res_buf_off:17947, dyn_buf_header_offset:8091, res_buf_len:128, eval_flags_off:7267, pvt_skip_off:2592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6344, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acb60}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2600, res_buf_off:19995, dyn_buf_header_offset:8347, res_buf_len:128, eval_flags_off:7275, pvt_skip_off:2792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6409, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acc48}], op_filters:NULL, trans_desc:NULL, snapshot:{this:0x2b4681014148, valid:true, source:2, core:{version:{val:1734400156139063000, v:0}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:1}, snapshot_ls_role:1, snapshot_acquire_addr:"192.168.159.137:2882", parts:[], committed:false}, table_param:{table_id:413, output_projector:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], aggregate_projector:[cnt:0], group_by_projector:[cnt:0], output_sel_mask:[cnt:14, true, true, true, true, true, true, true, true, true, true, true, true, true, true], pad_col_projector:[cnt:0], read_param_version:1, main_read_info:{schema_column_count:14, schema_rowkey_cnt:1, rowkey_cnt:3, trans_col_index:-1, mview_old_new_col_index:-1, group_idx_col_index:-1, seq_read_column_count:1, max_col_index:15, is_oracle_mode:false, cols_index:{rowkey_mode:false, for_memtable:false, array:{ObIArray:[cnt:14, 0, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15], data:0x2b45bb7b07a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, memtable_cols_index:{rowkey_mode:false, for_memtable:true, array:{ObIArray:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], data:0x2b45bb7b07e0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, cols_desc:{ObIArray:[cnt:14, column_id=18 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=24 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=25 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=26 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=27 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=28 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=29 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0], data:0x2b45bb7b06f0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, cg_idxs:{ObIArray:[cnt:0], data:null, count:0, allocator:null, capacity:0, init_cnt:0}, cols_extend:{ObIArray:[cnt:14, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}], data:0x2b45bb7b08a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, has_all_column_group:true, datum_utils:{is_oracle_mode:false, rowkey_cnt:3, is_inited:true, is_oracle_mode:false}, cols_param:[{column_id:18, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:16, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:17, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:19, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:20, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:128, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:21, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:256, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:22, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:23, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:4096, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:24, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:25, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:26, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:27, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:28, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:29, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}]}, use_lob_locator:false, rowid_version:0, rowid_projector:[cnt:0], enable_lob_locator_v2:true, is_fts_index:false, parser_name:"", is_vec_index:false, is_column_replica_table:false}, sample_info:{method:0, percent:"1.000000000000000000e+02", seed:-1, table_id:0, scope:0, force_block:false}, need_scn:false, need_switch_param:false, is_mds_query:false, fb_read_tx_uncommitted:false, external_file_format:{"TYPE":"INVALID"}, external_file_location:"", tx_seq_base:1734400156357521}) [2024-12-16 17:49:16.306913] WDIAG [STORAGE] table_scan (ob_access_service.cpp:369) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=600][errcode=-4012] Fail to scan table, (ret=-4012, ls_id={id:1}, param={tablet_id:{id:413}, ls_id:{id:1}, column_ids:[18, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29], index_id:413, key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"NULL":"NULL"};{"BIGINT UNSIGNED":0})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":0};{"BIGINT UNSIGNED":70000000})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":2000000000};MAX)"}], ss_key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}], range_array_pos:[], timeout:1734400156233659, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:1, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, reserved:0}, sql_mode:4194304, reserved_cell_count:14, schema_version:1734358805566592, query_begin_schema_version:-1, limit_offset:{offset_:0, limit_:-1}, for_update:false, wait:-1, frozen_version:-1, is_get:false, output_exprs:[cnt:14, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:0, res_buf_off:8603, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7171, pvt_skip_off:192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5564, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac080}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:200, res_buf_off:8731, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7179, pvt_skip_off:392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5629, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac168}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:400, res_buf_off:8859, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7187, pvt_skip_off:592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5694, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac250}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:600, res_buf_off:8987, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7195, pvt_skip_off:792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5759, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac338}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:800, res_buf_off:9115, dyn_buf_header_offset:7323, res_buf_len:128, eval_flags_off:7203, pvt_skip_off:992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5824, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac420}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1000, res_buf_off:11163, dyn_buf_header_offset:7579, res_buf_len:128, eval_flags_off:7211, pvt_skip_off:1192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5889, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac508}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1200, res_buf_off:13211, dyn_buf_header_offset:7835, res_buf_len:8, eval_flags_off:7219, pvt_skip_off:1392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5954, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac5f0}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1400, res_buf_off:13339, dyn_buf_header_offset:7835, res_buf_len:128, eval_flags_off:7227, pvt_skip_off:1592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6019, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac6d8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1600, res_buf_off:15387, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7235, pvt_skip_off:1792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6084, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac7c0}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1800, res_buf_off:16027, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7243, pvt_skip_off:1992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6149, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac8a8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2000, res_buf_off:16667, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7251, pvt_skip_off:2192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6214, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac990}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2200, res_buf_off:17307, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7259, pvt_skip_off:2392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6279, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7aca78}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2400, res_buf_off:17947, dyn_buf_header_offset:8091, res_buf_len:128, eval_flags_off:7267, pvt_skip_off:2592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6344, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acb60}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2600, res_buf_off:19995, dyn_buf_header_offset:8347, res_buf_len:128, eval_flags_off:7275, pvt_skip_off:2792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6409, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acc48}], op_filters:NULL, trans_desc:NULL, snapshot:{this:0x2b4681014148, valid:true, source:2, core:{version:{val:1734400156139063000, v:0}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:1}, snapshot_ls_role:1, snapshot_acquire_addr:"192.168.159.137:2882", parts:[], committed:false}, table_param:{table_id:413, output_projector:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], aggregate_projector:[cnt:0], group_by_projector:[cnt:0], output_sel_mask:[cnt:14, true, true, true, true, true, true, true, true, true, true, true, true, true, true], pad_col_projector:[cnt:0], read_param_version:1, main_read_info:{schema_column_count:14, schema_rowkey_cnt:1, rowkey_cnt:3, trans_col_index:-1, mview_old_new_col_index:-1, group_idx_col_index:-1, seq_read_column_count:1, max_col_index:15, is_oracle_mode:false, cols_index:{rowkey_mode:false, for_memtable:false, array:{ObIArray:[cnt:14, 0, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15], data:0x2b45bb7b07a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, memtable_cols_index:{rowkey_mode:false, for_memtable:true, array:{ObIArray:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], data:0x2b45bb7b07e0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, cols_desc:{ObIArray:[cnt:14, column_id=18 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=24 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=25 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=26 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=27 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=28 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=29 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0], data:0x2b45bb7b06f0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, cg_idxs:{ObIArray:[cnt:0], data:null, count:0, allocator:null, capacity:0, init_cnt:0}, cols_extend:{ObIArray:[cnt:14, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}], data:0x2b45bb7b08a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, has_all_column_group:true, datum_utils:{is_oracle_mode:false, rowkey_cnt:3, is_inited:true, is_oracle_mode:false}, cols_param:[{column_id:18, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:16, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:17, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:19, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:20, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:128, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:21, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:256, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:22, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:23, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:4096, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:24, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:25, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:26, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:27, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:28, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:29, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}]}, use_lob_locator:false, rowid_version:0, rowid_projector:[cnt:0], enable_lob_locator_v2:true, is_fts_index:false, parser_name:"", is_vec_index:false, is_column_replica_table:false}, sample_info:{method:0, percent:"1.000000000000000000e+02", seed:-1, table_id:0, scope:0, force_block:false}, need_scn:false, need_switch_param:false, is_mds_query:false, fb_read_tx_uncommitted:false, external_file_format:{"TYPE":"INVALID"}, external_file_location:"", tx_seq_base:1734400156357521}) [2024-12-16 17:49:16.307354] WDIAG [SQL.DAS] do_table_scan (ob_das_scan_iter.cpp:83) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=438][errcode=-4012] fail to scan table(scan_param={tablet_id:{id:413}, ls_id:{id:1}, column_ids:[18, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29], index_id:413, key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"NULL":"NULL"};{"BIGINT UNSIGNED":0})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":0};{"BIGINT UNSIGNED":70000000})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":2000000000};MAX)"}], ss_key_ranges:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}], range_array_pos:[], timeout:1734400156233659, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:1, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, reserved:0}, sql_mode:4194304, reserved_cell_count:14, schema_version:1734358805566592, query_begin_schema_version:-1, limit_offset:{offset_:0, limit_:-1}, for_update:false, wait:-1, frozen_version:-1, is_get:false, output_exprs:[cnt:14, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:0, res_buf_off:8603, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7171, pvt_skip_off:192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5564, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac080}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:200, res_buf_off:8731, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7179, pvt_skip_off:392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5629, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac168}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:400, res_buf_off:8859, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7187, pvt_skip_off:592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5694, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac250}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:600, res_buf_off:8987, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7195, pvt_skip_off:792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5759, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac338}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:800, res_buf_off:9115, dyn_buf_header_offset:7323, res_buf_len:128, eval_flags_off:7203, pvt_skip_off:992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5824, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac420}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1000, res_buf_off:11163, dyn_buf_header_offset:7579, res_buf_len:128, eval_flags_off:7211, pvt_skip_off:1192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5889, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac508}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1200, res_buf_off:13211, dyn_buf_header_offset:7835, res_buf_len:8, eval_flags_off:7219, pvt_skip_off:1392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5954, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac5f0}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1400, res_buf_off:13339, dyn_buf_header_offset:7835, res_buf_len:128, eval_flags_off:7227, pvt_skip_off:1592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6019, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac6d8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1600, res_buf_off:15387, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7235, pvt_skip_off:1792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6084, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac7c0}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1800, res_buf_off:16027, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7243, pvt_skip_off:1992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6149, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac8a8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2000, res_buf_off:16667, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7251, pvt_skip_off:2192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6214, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac990}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2200, res_buf_off:17307, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7259, pvt_skip_off:2392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6279, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7aca78}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2400, res_buf_off:17947, dyn_buf_header_offset:8091, res_buf_len:128, eval_flags_off:7267, pvt_skip_off:2592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6344, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acb60}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2600, res_buf_off:19995, dyn_buf_header_offset:8347, res_buf_len:128, eval_flags_off:7275, pvt_skip_off:2792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6409, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acc48}], op_filters:NULL, trans_desc:NULL, snapshot:{this:0x2b4681014148, valid:true, source:2, core:{version:{val:1734400156139063000, v:0}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:1}, snapshot_ls_role:1, snapshot_acquire_addr:"192.168.159.137:2882", parts:[], committed:false}, table_param:{table_id:413, output_projector:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], aggregate_projector:[cnt:0], group_by_projector:[cnt:0], output_sel_mask:[cnt:14, true, true, true, true, true, true, true, true, true, true, true, true, true, true], pad_col_projector:[cnt:0], read_param_version:1, main_read_info:{schema_column_count:14, schema_rowkey_cnt:1, rowkey_cnt:3, trans_col_index:-1, mview_old_new_col_index:-1, group_idx_col_index:-1, seq_read_column_count:1, max_col_index:15, is_oracle_mode:false, cols_index:{rowkey_mode:false, for_memtable:false, array:{ObIArray:[cnt:14, 0, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15], data:0x2b45bb7b07a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, memtable_cols_index:{rowkey_mode:false, for_memtable:true, array:{ObIArray:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], data:0x2b45bb7b07e0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, cols_desc:{ObIArray:[cnt:14, column_id=18 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=24 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=25 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=26 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=27 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=28 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=29 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0], data:0x2b45bb7b06f0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, cg_idxs:{ObIArray:[cnt:0], data:null, count:0, allocator:null, capacity:0, init_cnt:0}, cols_extend:{ObIArray:[cnt:14, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}], data:0x2b45bb7b08a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, has_all_column_group:true, datum_utils:{is_oracle_mode:false, rowkey_cnt:3, is_inited:true, is_oracle_mode:false}, cols_param:[{column_id:18, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:16, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:17, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:19, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:20, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:128, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:21, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:256, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:22, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:23, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:4096, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:24, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:25, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:26, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:27, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:28, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:29, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}]}, use_lob_locator:false, rowid_version:0, rowid_projector:[cnt:0], enable_lob_locator_v2:true, is_fts_index:false, parser_name:"", is_vec_index:false, is_column_replica_table:false}, sample_info:{method:0, percent:"1.000000000000000000e+02", seed:-1, table_id:0, scope:0, force_block:false}, need_scn:false, need_switch_param:false, is_mds_query:false, fb_read_tx_uncommitted:false, external_file_format:{"TYPE":"INVALID"}, external_file_location:"", tx_seq_base:1734400156357521}, ret=-4012) [2024-12-16 17:49:16.307841] WDIAG [SQL.DAS] open_op (ob_das_scan_op.cpp:546) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=483][errcode=-4012] iter tree failed to do table scan(ret=-4012) [2024-12-16 17:49:16.307853] WDIAG [SQL.DAS] start_das_task (ob_das_task.cpp:331) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=11][errcode=-4012] open das task op failed(ret=-4012) [2024-12-16 17:49:16.307861] WDIAG [SQL.DAS] execute_das_task (ob_data_access_service.cpp:98) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=7][errcode=-4012] start das task failed(ret=-4012, *task_wrapper.at(i)={parent:{tenant_id:1, task_id:25978605, op_type:1, errcode:-4012, can_part_retry:0, task_started:1, in_part_retry:0, in_stmt_retry:0, need_switch_param:0, trans_desc:{this:0x2b45b6839360, tx_id:{txid:0}, state:1, addr:"192.168.159.137:2882", tenant_id:1, session_id:3221544372, assoc_session_id:3221544372, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:-1, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:1, alloc_ts:1734400156302404, active_ts:-1, commit_ts:-1, finish_ts:-1, timeout_us:-1, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:-1, cluster_version:17180066816, seq_base:1734400156357521, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:1}, snapshot:{this:0x2b46810094a0, valid:true, source:2, core:{version:{val:1734400156139063000, v:0}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:1}, snapshot_ls_role:1, snapshot_acquire_addr:"192.168.159.137:2882", parts:[], committed:false}, tablet_id:{id:413}, ls_id:{id:1}, tablet_loc:{tablet_id:{id:413}, ls_id:{id:1}, server:"192.168.159.137:2882", loc_meta:{table_loc_id:18446744073709551614, ref_table_id:413, related_table_ids:[cnt:0], use_dist_das:0, select_leader:1, is_dup_table:0, is_weak_read:0, unuse_related_pruning:0, is_external_table:0, route_policy:1}, in_retry:0, partition_id:413, first_level_part_id:18446744073709551615}, related_ctdefs:[cnt:0], related_rtdefs:[cnt:0], task_status:1, related_tablet_ids:[cnt:0], das_task_node:, plan_line_id:0}, scan_ctdef:{ObDASBaseCtDef:{op_type:1, children_cnt:0}, ref_table_id:413, access_column_ids:[cnt:14, 18, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29], aggregate_column_ids:[cnt:0], group_by_column_ids:[cnt:0], schema_version:1734358805566592, table_param:{table_id:413, output_projector:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], aggregate_projector:[cnt:0], group_by_projector:[cnt:0], output_sel_mask:[cnt:14, true, true, true, true, true, true, true, true, true, true, true, true, true, true], pad_col_projector:[cnt:0], read_param_version:1, main_read_info:{schema_column_count:14, schema_rowkey_cnt:1, rowkey_cnt:3, trans_col_index:-1, mview_old_new_col_index:-1, group_idx_col_index:-1, seq_read_column_count:1, max_col_index:15, is_oracle_mode:false, cols_index:{rowkey_mode:false, for_memtable:false, array:{ObIArray:[cnt:14, 0, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15], data:0x2b45bb7b07a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, memtable_cols_index:{rowkey_mode:false, for_memtable:true, array:{ObIArray:[cnt:14, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13], data:0x2b45bb7b07e0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}}, cols_desc:{ObIArray:[cnt:14, column_id=18 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=24 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=25 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=26 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=27 {type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=28 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=29 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0], data:0x2b45bb7b06f0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, cg_idxs:{ObIArray:[cnt:0], data:null, count:0, allocator:null, capacity:0, init_cnt:0}, cols_extend:{ObIArray:[cnt:14, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}, {pack:0, min_max:0, sum:0}], data:0x2b45bb7b08a0, count:14, allocator:0x2b45bb7a46b0, capacity:14, init_cnt:14}, has_all_column_group:true, datum_utils:{is_oracle_mode:false, rowkey_cnt:3, is_inited:true, is_oracle_mode:false}, cols_param:[{column_id:18, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:16, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:17, meta_type:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:25, scale:6}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"EXT":"CURRENT_TIMESTAMP"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:19, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:20, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:128, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:21, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:256, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:22, meta_type:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:20, scale:0}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:23, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:4096, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:false, is_nullable_for_read:false, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:24, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:25, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:26, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:27, meta_type:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, order:0, accuracy:{length:-1, precision:38, scale:10}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:28, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}, {column_id:29, meta_type:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}, order:0, accuracy:{length:2048, precision:-1, scale:-1}, orig_default_value:{"NULL":"NULL"}, cur_default_value:{"NULL":"NULL"}, is_nullable_for_write:true, is_nullable_for_read:true, is_gen_col:false, is_virtual_gen_col:false, is_gen_col_udf_expr:false, is_hidden:false, lob_chunk_size:262144}]}, use_lob_locator:false, rowid_version:0, rowid_projector:[cnt:0], enable_lob_locator_v2:true, is_fts_index:false, parser_name:"", is_vec_index:false, is_column_replica_table:false}, pd_expr_spec:{calc_exprs:[cnt:0], access_exprs:[cnt:14, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:0, res_buf_off:8603, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7171, pvt_skip_off:192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5564, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac080}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:200, res_buf_off:8731, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7179, pvt_skip_off:392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5629, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac168}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:400, res_buf_off:8859, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7187, pvt_skip_off:592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5694, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac250}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:600, res_buf_off:8987, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7195, pvt_skip_off:792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5759, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac338}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:800, res_buf_off:9115, dyn_buf_header_offset:7323, res_buf_len:128, eval_flags_off:7203, pvt_skip_off:992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5824, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac420}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1000, res_buf_off:11163, dyn_buf_header_offset:7579, res_buf_len:128, eval_flags_off:7211, pvt_skip_off:1192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5889, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac508}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1200, res_buf_off:13211, dyn_buf_header_offset:7835, res_buf_len:8, eval_flags_off:7219, pvt_skip_off:1392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5954, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac5f0}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1400, res_buf_off:13339, dyn_buf_header_offset:7835, res_buf_len:128, eval_flags_off:7227, pvt_skip_off:1592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6019, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac6d8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1600, res_buf_off:15387, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7235, pvt_skip_off:1792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6084, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac7c0}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1800, res_buf_off:16027, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7243, pvt_skip_off:1992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6149, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac8a8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2000, res_buf_off:16667, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7251, pvt_skip_off:2192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6214, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac990}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2200, res_buf_off:17307, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7259, pvt_skip_off:2392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6279, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7aca78}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2400, res_buf_off:17947, dyn_buf_header_offset:8091, res_buf_len:128, eval_flags_off:7267, pvt_skip_off:2592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6344, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acb60}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2600, res_buf_off:19995, dyn_buf_header_offset:8347, res_buf_len:128, eval_flags_off:7275, pvt_skip_off:2792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6409, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acc48}], ext_file_column_exprs:[cnt:0], ext_column_convert_exprs:[cnt:0], max_batch_size:16, pushdown_filters:[cnt:0], pd_storage_flag:{pd_flag:16}, trans_info_expr:NULL}, group_id_expr:NULL, result_output:[cnt:14, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:200, res_buf_off:8731, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7179, pvt_skip_off:392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5629, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac168}, {type:"T_REF_COLUMN", datum_meta:{type:"TIMESTAMP", cs_type:"binary", scale:6, precision:25}, obj_meta:{type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:400, res_buf_off:8859, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7187, pvt_skip_off:592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5694, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac250}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:0, res_buf_off:8603, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7171, pvt_skip_off:192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5564, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac080}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:600, res_buf_off:8987, dyn_buf_header_offset:7323, res_buf_len:8, eval_flags_off:7195, pvt_skip_off:792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5759, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac338}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:800, res_buf_off:9115, dyn_buf_header_offset:7323, res_buf_len:128, eval_flags_off:7203, pvt_skip_off:992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5824, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac420}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1000, res_buf_off:11163, dyn_buf_header_offset:7579, res_buf_len:128, eval_flags_off:7211, pvt_skip_off:1192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5889, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac508}, {type:"T_REF_COLUMN", datum_meta:{type:"BIGINT UNSIGNED", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT UNSIGNED", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:195, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1200, res_buf_off:13211, dyn_buf_header_offset:7835, res_buf_len:8, eval_flags_off:7219, pvt_skip_off:1392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:5954, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac5f0}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1400, res_buf_off:13339, dyn_buf_header_offset:7835, res_buf_len:128, eval_flags_off:7227, pvt_skip_off:1592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6019, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac6d8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1600, res_buf_off:15387, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7235, pvt_skip_off:1792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6084, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac7c0}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:1800, res_buf_off:16027, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7243, pvt_skip_off:1992, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6149, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac8a8}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2000, res_buf_off:16667, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7251, pvt_skip_off:2192, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6214, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7ac990}, {type:"T_REF_COLUMN", datum_meta:{type:"DECIMAL", cs_type:"binary", scale:10, precision:38}, obj_meta:{type:"DECIMAL", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:2, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2200, res_buf_off:17307, dyn_buf_header_offset:8091, res_buf_len:40, eval_flags_off:7259, pvt_skip_off:2392, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6279, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7aca78}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2400, res_buf_off:17947, dyn_buf_header_offset:8091, res_buf_len:128, eval_flags_off:7267, pvt_skip_off:2592, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6344, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acb60}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:131, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:2600, res_buf_off:19995, dyn_buf_header_offset:8347, res_buf_len:128, eval_flags_off:7275, pvt_skip_off:2792, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:6409, eval_vector_func:null, local_session_var_id:-1, this:0x2b45bb7acc48}], is_get:false, is_external_table:false, external_files:[cnt:0], external_file_format_str:{str:""}, external_file_location:{str:""}, trans_info_expr:NULL, ir_scan_type:0, rowkey_exprs:[cnt:0], table_scan_opt:{io_read_batch_size:0, io_read_gap_size:0, storage_rowsets_size:8192}, doc_id_idx:-1, vec_vid_idx:-1, index_merge_idx:-1, pre_query_range:[], is_index_merge:0}, scan_rtdef:{ObDASBaseRtDef:{op_type:1, children_cnt:0}, tenant_schema_version:-1, limit_param:{offset_:0, limit_:-1}, need_scn:false, force_refresh_lc:false, frozen_version:-1, fb_snapshot:{val:18446744073709551615, v:3}, fb_read_tx_uncommitted:false, timeout_ts:1734400156233659, tx_lock_timeout:-1, sql_mode:4194304, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:1, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, reserved:0}, tsc_monitor_info:{*io_read_bytes_:0*ssstore_read_bytes_:0*ssstore_read_row_cnt_:0*memstore_read_row_cnt_:0}, key_ranges:[], ss_key_ranges:[], mbr_filters:[], task_count:1, scan_op_id:18446744073709551615, scan_rows:-1, row_width:-1}, scan_range:[{"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"NULL":"NULL"};{"BIGINT UNSIGNED":0})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":0};{"BIGINT UNSIGNED":70000000})"}, {"range":"table_id:413,group_idx:0,index_ordered_idx:0,({"BIGINT UNSIGNED":2000000000};MAX)"}], result:{}, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:1, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, reserved:0}}) [2024-12-16 17:49:16.308513] WDIAG [SQL.DAS] execute_all_task (ob_das_ref.cpp:268) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=647][errcode=-4012] failed to execute aggregated das task(ret=-4012, ret="OB_TIMEOUT", aggregated_task={server:"192.168.159.137:2882", high_priority_tasks_.get_size():0, tasks_.get_size():0, failed_tasks_.get_size():1, success_tasks_.get_size():0}, async=true) [2024-12-16 17:49:16.308530] WDIAG [SQL.DAS] do_table_scan (ob_das_merge_iter.cpp:259) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=15][errcode=-4012] failed to execute all das task(ret=-4012) [2024-12-16 17:49:16.308538] WDIAG [SQL.ENG] do_table_scan (ob_table_scan_op.cpp:2604) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=7][errcode=-4012] execute all das scan task failed(ret=-4012) [2024-12-16 17:49:16.308545] WDIAG [SQL.ENG] do_init_before_get_row (ob_table_scan_op.cpp:1801) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=6][errcode=-4012] fail to do table scan(ret=-4012) [2024-12-16 17:49:16.308551] WDIAG [SQL.ENG] inner_get_next_batch_for_tsc (ob_table_scan_op.cpp:2493) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=6][errcode=-4012] failed to init before get row(ret=-4012) [2024-12-16 17:49:16.308557] WDIAG [SQL.ENG] inner_get_next_batch (ob_table_scan_op.cpp:2454) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=5][errcode=-4012] failed to get next batch(ret=-4012) [2024-12-16 17:49:16.308564] WDIAG [SQL.ENG] get_next_batch (ob_operator.cpp:1300) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=5][errcode=-4012] get next batch failed(ret=-4012, eval_ctx={batch_idx:0, batch_size:16, max_batch_size:16, frames_:0x2b468100b680}, id=0, op_name="PHY_VEC_TABLE_SCAN") [2024-12-16 17:49:16.308576] WDIAG [SQL.ENG] get_next_row (ob_operator.cpp:1744) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=12][errcode=-4012] get next batch failed(ret=-4012) [2024-12-16 17:49:16.308583] WDIAG [SQL.EXE] sync_send_result (ob_remote_executor_processor.cpp:286) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=6][errcode=-4012] failed to get next row(ret=-4012) [2024-12-16 17:49:16.308589] WDIAG [SQL.EXE] execute_remote_plan (ob_remote_executor_processor.cpp:485) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=6][errcode=-4012] sync send result failed(ret=-4012) [2024-12-16 17:49:16.308607] INFO [SQL.EXE] end_stmt (ob_sql_trans_control.cpp:1362) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=6] end stmt(ret=0, tx_id=0, plain_select=true, stmt_type=1, savepoint=0, tx_desc={this:0x2b45b6839360, tx_id:{txid:0}, state:1, addr:"192.168.159.137:2882", tenant_id:1, session_id:3221544372, assoc_session_id:3221544372, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:-1, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:1, alloc_ts:1734400156302404, active_ts:-1, commit_ts:-1, finish_ts:-1, timeout_us:-1, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:-1, cluster_version:17180066816, seq_base:1734400156357521, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:1}, trans_result={incomplete:false, parts:[], touched_ls_list:[], conflict_txs:[]}, rollback=true, need_rollback=true, session={this:0x2b45c57dc1f8, id:3221544372, deser:true, tenant:"", tenant_id:1, effective_tenant:"", effective_tenant_id:1, database:"oceanbase", user:"root@%", consistency_level:3, session_state:2, autocommit:true, tx:0x2b45b6839360}, exec_ctx.get_errcode()=0) [2024-12-16 17:49:16.308778] WDIAG [SQL.EXE] execute_with_sql (ob_remote_executor_processor.cpp:712) [128855][T1_L0_G0][T1][YB42C0A89F8A-00062963E089EAD4-0-0] [lt=158][errcode=-4012] execute remote plan failed(ret=-4012, task={tenant_schema_version:1734362366739016, sys_schema_version:1734362366739016, runner_svr:"192.168.159.137:2882", ctrl_svr:"192.168.159.138:2882", task_id:{ob_job_id:{ob_execution_id:{server:"192.168.159.138:2882", execution_id:18446744073709551615, task_type:0, hash:4219408603045787357}, job_id:18446744073709551615}, task_id:0, task_cnt:0}, remote_sql_info:{use_ps:true, is_batched_stmt:false, is_original_ps_mode:false, ps_param_cnt:3, remote_sql:"SELECT * FROM __all_spatial_reference_systems WHERE (SRS_ID < ? AND SRS_ID != ?) OR SRS_ID > ?", ps_params:[{obj:{"BIGINT":70000000}, accuracy:{length:8, precision:8, scale:0}, flag:1, raw_text_pos:-1, raw_text_len:-1, param_meta:{type:"BIGINT", collation:"binary", coercibility:"NUMERIC"}}, {obj:{"BIGINT":0}, accuracy:{length:1, precision:1, scale:0}, flag:1, raw_text_pos:-1, raw_text_len:-1, param_meta:{type:"BIGINT", collation:"binary", coercibility:"NUMERIC"}}, {obj:{"BIGINT":2000000000}, accuracy:{length:10, precision:10, scale:0}, flag:1, raw_text_pos:-1, raw_text_len:-1, param_meta:{type:"BIGINT", collation:"binary", coercibility:"NUMERIC"}}]}, snapshot:{this:0x2b4681004208, valid:false, source:0, core:{version:{val:18446744073709551615, v:3}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:-1}, snapshot_ls_role:0, snapshot_acquire_addr:"0.0.0.0:0", parts:[], committed:false}}, exec_ctx_.get_das_ctx().get_snapshot()={this:0x2b46810094a0, valid:true, source:2, core:{version:{val:1734400156139063000, v:0}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:1}, snapshot_ls_role:1, snapshot_acquire_addr:"192.168.159.137:2882", parts:[], committed:false}) [2024-12-16 17:49:16.309339] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-0006296423659FA1-0-0] [lt=22][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=106481, send_timestamp=1734400156202855, peer="192.168.159.142:49912", sz=265) [2024-12-16 17:49:16.314287] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-0006296424B5A149-0-0] [lt=29][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=101729, send_timestamp=1734400156212555, peer="192.168.159.142:49904", sz=265) [2024-12-16 17:49:16.318082] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=9087, avg_group_log_size=649) [2024-12-16 17:49:16.318125] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, append size=9087) [2024-12-16 17:49:16.319666] INFO [LIB] stat (utility.h:1176) [129964][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1537, this=0x2b460dffbbb0, extra_info="palf_id:1") [2024-12-16 17:49:16.319713] INFO [LIB] stat (utility.h:1193) [129964][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1050, this=0x2b46037b0530, extra_info="") [2024-12-16 17:49:16.320220] INFO [LIB] stat (utility.h:1176) [129963][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=18, this=0x2b460dffbde0, extra_info="palf_id:1") [2024-12-16 17:49:16.321029] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [130059][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=75] tx gc loop thread is running(MTL_ID()=1001) [2024-12-16 17:49:16.321116] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [130059][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=84] try gc retain ctx [2024-12-16 17:49:16.321127] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [130059][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=12] try to retry start_working [2024-12-16 17:49:16.321204] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [130059][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=5] finish update min start scn(max_decided_scn={val:1734400156172258000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1734400146256155001, v:0}, keep_alive_scn_:{val:1734400151300687001, v:0}, update_ts_:1734400156320756}) [2024-12-16 17:49:16.321957] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [130059][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=19] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734387451893035000, v:0}, clog_base_lsn:{lsn:268419072}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1734359152843519000, v:0}, all_id_meta:{id_meta:[{limited_id:1734400170422253000, latest_log_ts:{val:1734400153830905001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734365294344570001, v:0}}, {limited_id:60000001, latest_log_ts:{val:1734374865140781001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b46037aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-12-16 17:49:16.334456] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.334805] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [129824][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=444] ====== tenant freeze timer task ====== [2024-12-16 17:49:16.340524] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [128728][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1734400156039929000, v:0}, base_version={val:1734400155936556000, v:0}, server_count=6, svr_array=[{addr:"192.168.159.137:2882", version:{val:1734400156139063000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1734400156340487, is_skipped:false}, {addr:"192.168.159.138:2882", version:{val:1734400156139063000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1734400156191700, is_skipped:false}, {addr:"192.168.159.139:2882", version:{val:1734400156039929000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1734400156325684, is_skipped:false}, {addr:"192.168.159.141:2882", version:{val:1734400151587110000, v:0}, valid_part_count:0, total_part_count:0, generate_tstamp:1734400156236169, is_skipped:true}, {addr:"192.168.159.142:2882", version:{val:1734400151482532000, v:0}, valid_part_count:0, total_part_count:0, generate_tstamp:1734400156197525, is_skipped:true}, {addr:"192.168.159.143:2882", version:{val:1734400151571597000, v:0}, valid_part_count:0, total_part_count:0, generate_tstamp:1734400156329695, is_skipped:true}], skip_server_count=3, skip_servers=["192.168.159.141:2882", "192.168.159.142:2882", "192.168.159.143:2882"]) [2024-12-16 17:49:16.346325] INFO eloop_run (eloop.c:140) [128490][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1734400156346322, bytes: 19302151614, bw: 0.985884 MB/s, add_ts: 1001416, add_bytes: 1035238 [2024-12-16 17:49:16.356082] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=8] tx gc loop thread is running(MTL_ID()=1002) [2024-12-16 17:49:16.356125] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] try gc retain ctx [2024-12-16 17:49:16.356136] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=10] try to retry start_working [2024-12-16 17:49:16.356168] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=5] finish update min start scn(max_decided_scn={val:1734400156202238000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1734400146180524001, v:0}, keep_alive_scn_:{val:1734400151195679000, v:0}, update_ts_:1734400156355360}) [2024-12-16 17:49:16.357092] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734359177596727005, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1734400152903940004, v:0}, tablet_change_checkpoint_scn:{val:1734359182135261001, v:0}, all_id_meta:{id_meta:[{limited_id:1734400165212056000, latest_log_ts:{val:1734400148559348001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734370580592908002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b45db5f2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:433339352, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-12-16 17:49:16.357349] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=122] finish update min start scn(max_decided_scn={val:1734400156202238000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1734400146180524001, v:0}, keep_alive_scn_:{val:1734400151195679001, v:0}, update_ts_:1734400156355360}) [2024-12-16 17:49:16.358302] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=72] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734400154408796004, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1734400152903940004, v:0}, tablet_change_checkpoint_scn:{val:1734359202081793999, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b45db5f2030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-12-16 17:49:16.358512] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=89] finish update min start scn(max_decided_scn={val:1734400155907978003, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1734400150898189000, v:0}, keep_alive_scn_:{val:1734400155907978000, v:0}, update_ts_:1734400156355360}) [2024-12-16 17:49:16.359416] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1002}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734400154905235002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1734400152903940004, v:0}, tablet_change_checkpoint_scn:{val:1734359202110028999, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:2, proposal_id:0, palf_env_:0x2b45db5f2030, is_in_stop_state_:false, is_inited_:true, id_:1002}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1002, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:978109984, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-12-16 17:49:16.368576] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [130058][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-12-16 17:49:16.372389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=6) [2024-12-16 17:49:16.391903] WDIAG begin (ob_hashtable.h:954) [128851][T1_L0_G0][T1][YB42C0A89F8B-00062963E2AF502B-0-0] [lt=216][errcode=-4006] hashtable not init, backtrace=0x7bcec65 0x10e56fc4 0x10c3334e 0x127d5d5e 0x128943bc 0x79a8fba 0x7b14b1e 0x7b14a62 0x7b14a62 0x7b1436d 0x7a43500 0x7a356ac 0x7a348d8 0x7a344f4 0x11dd5114 0x7a3376f 0x7a2ba1e 0x7a26ade 0x7a155ee 0x76c8f84 0x76c547e 0x1287b4fd 0x108aab76 0x108aa665 0x7be5a58 0x74c49cc 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d [2024-12-16 17:49:16.394909] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [128851][T1_L0_G0][T1][YB42C0A89F8B-00062963E2AF502B-0-0] [lt=29][errcode=0] set logical del time(cache_obj->get_logical_del_time()=168637954303, cache_obj->added_lc()=false, cache_obj->get_object_id()=95448, cache_obj->get_tenant_id()=1, lbt()="0x7bcec65 0xfb1dce8 0x750765e 0xfa904bd 0xf0e183a 0xefff187 0x74c3b9f 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d") [2024-12-16 17:49:16.412988] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-0006296424B5A14A-0-0] [lt=35][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100350, send_timestamp=1734400156312634, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:16.418576] INFO [COMMON] print_status (ob_io_manager.cpp:288) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SERVER] net_in=1031kB/s, net_out=508kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2024-12-16 17:49:16.418683] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 , local_read=0 0 , local_write=0 0 , remote_read=0 0 , remote_write=0 0 ) [2024-12-16 17:49:16.418740] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:326, idx_:0, tid_:128690}], io_callback_status=runner 0: thread_id=128690, queue_count=0, ) [2024-12-16 17:49:16.418857] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:452, idx_:0, tid_:130008}], io_callback_status=runner 0: thread_id=130008, queue_count=0, ) [2024-12-16 17:49:16.418941] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:3, bw:12044, [delay/us]:prepare:18, schedule:80, submit:6, rt:1184, total:1289) [2024-12-16 17:49:16.418972] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:4294967296, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:4}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=29368544, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0, 0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2024-12-16 17:49:16.419062] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:3, avg_bw:12043, [delay/us]: prepare:18, schedule:80, submit:6, device:1184, total:1289) [2024-12-16 17:49:16.419083] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:392, idx_:0, tid_:129843}, {is_inited_:true, queue_.get_total():0, tg_id_:400, idx_:1, tid_:129951}], io_callback_status=runner 0: thread_id=129843, queue_count=0, runner 1: thread_id=129951, queue_count=0, ) [2024-12-16 17:49:16.419105] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4014, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:579, total:589) [2024-12-16 17:49:16.419211] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2024-12-16 17:49:16.419293] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4014, [delay/us]: prepare:0, schedule:0, submit:600000000, device:579, total:589) [2024-12-16 17:49:16.419317] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:271, idx_:0, tid_:128596}], io_callback_status=runner 0: thread_id=128596, queue_count=0, ) [2024-12-16 17:49:16.419334] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2024-12-16 17:49:16.419343] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [128597][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt=, async_cnt= 0 [2024-12-16 17:49:16.421011] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [128568][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-12-16 17:49:16.428524] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629642351F7C8-0-0] [lt=137][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=101410, send_timestamp=1734400156327110, peer="192.168.159.142:49916", sz=1543) [2024-12-16 17:49:16.434130] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629642351F7C9-0-0] [lt=71][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=101236, send_timestamp=1734400156332892, peer="192.168.159.142:49912", sz=1606) [2024-12-16 17:49:16.434713] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.438468] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [128769][T1_L5_G0][T1][YB42C0A89F8D-000629641A28AED8-0-0] [lt=13] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-12-16 17:49:16.442955] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=11] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=12478464) [2024-12-16 17:49:16.442988] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] Construct Queue Num(construct_num=0, get_push_idx()=70, get_cur_idx()=62, get_pop_idx()=62) [2024-12-16 17:49:16.457595] INFO [LIB] stat (utility.h:1176) [129796][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2359, this=0x2b46342f9bb0, extra_info="palf_id:1001") [2024-12-16 17:49:16.457630] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129796][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=1211) [2024-12-16 17:49:16.457736] INFO [LIB] stat (utility.h:1193) [129796][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=97] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1249, this=0x2b45db5f8c70, extra_info="") [2024-12-16 17:49:16.457829] INFO [LIB] stat (utility.h:1176) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x2b46342f9de0, extra_info="palf_id:1001") [2024-12-16 17:49:16.472277] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [129882][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1734400155907978003, v:0}, total_part_count:3, valid_inner_part_count:1, valid_user_part_count:2}, server_version_delta=564279, in_cluster_service=true, cluster_version={val:1734400155907978001, v:0}, min_cluster_version={val:1734400155907978001, v:0}, max_cluster_version={val:1734400155907978001, v:0}, get_cluster_version_err=0, cluster_version_delta=564279, cluster_service_master="192.168.159.137:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=404391, succ_cluster_heartbeat_count=4, cluster_heartbeat_interval=50000, local_cluster_version={val:1734399513269417001, v:0}, local_cluster_delta=643202840, force_self_check=false, weak_read_refresh_interval=100000) [2024-12-16 17:49:16.472891] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [128550][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=21] skip inspect bad block(last_check_time=1734358755886704, last_macro_idx=-1) [2024-12-16 17:49:16.486309] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [128637][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=39] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-12-16 17:49:16.486957] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641F33D3DF-0-0] [lt=103][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1808, fly_ts=111066, send_timestamp=1734400156375887, peer="192.168.159.142:49904", sz=257) [2024-12-16 17:49:16.492930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=107] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1432793088, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:16.521018] INFO [LIB] stat (utility.h:1176) [129287][T1001_L0_G1][T1001][YB42C0A89F8A-00062963E9CCB094-0-0] [lt=58] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=35, this=0x2b460dff16a0, extra_info="palf_id:1") [2024-12-16 17:49:16.521057] INFO [LIB] stat (utility.h:1176) [129287][T1001_L0_G1][T1001][YB42C0A89F8A-00062963E9CCB094-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5220, this=0x2b460dff18d0, extra_info="palf_id:1") [2024-12-16 17:49:16.521070] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129287][T1001_L0_G1][T1001][YB42C0A89F8A-00062963E9CCB094-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="192.168.159.137:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=104, avg_log_submit_to_flush_time=3626, avg_log_submit_to_slide_time=5115) [2024-12-16 17:49:16.521326] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [129857][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=33] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=133808, offset=39931400}, end_cursor:ObLogCursor{file_id=1, log_id=133809, offset=39931705}, is_inited:true, is_local:false, buf_size:8192, buf:0x2b457697e050, len:504, log_data_len:305, seq:133808, flush_finish:false, flush_ret:0}) [2024-12-16 17:49:16.522719] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [129291][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F413-0-0] [lt=21] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2024-12-16 17:49:16.522764] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [129291][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F413-0-0] [lt=27] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1734400156420076000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1734400156420076000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"192.168.159.137:2882"}, offline_scn={val:18446744073709551615, v:3}) [2024-12-16 17:49:16.533661] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [129857][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=28] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=133809, offset=39931705}, end_cursor:ObLogCursor{file_id=1, log_id=133810, offset=39932002}, is_inited:true, is_local:false, buf_size:8192, buf:0x2b4576976050, len:4295, log_data_len:297, seq:133809, flush_finish:false, flush_ret:0}) [2024-12-16 17:49:16.533976] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [129291][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F413-0-0] [lt=23] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2024-12-16 17:49:16.534095] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [129291][T1002_L0_G18][T1002][YB42C0A89F89-00062963E523F413-0-0] [lt=41] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1734400156420076000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1734400156420076000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"192.168.159.137:2882"}, offline_scn={val:18446744073709551615, v:3}) [2024-12-16 17:49:16.534922] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.543837] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=18947) [2024-12-16 17:49:16.543867] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [129857][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=133810, offset=39932002}, end_cursor:ObLogCursor{file_id=1, log_id=133811, offset=39932299}, is_inited:true, is_local:false, buf_size:8192, buf:0x2b457697a050, len:3998, log_data_len:297, seq:133810, flush_finish:false, flush_ret:0}) [2024-12-16 17:49:16.545999] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=11] skip repeat study(ret=0, this={this:0x2b45985b0f30, last_study_timestamp:1734399856262338, last_refresh_timestamp:1734400096524324, last_reclaim_timestamp:1734399856266437, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1734399697335343000, v:0}, is_inited:true}, current_timestamp=1734400156545996, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2024-12-16 17:49:16.548537] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=47] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399856252534000, snapshot_type=1, create_time=1734399856255234, addr="192.168.159.137:2882", gc_status=0) [2024-12-16 17:49:16.548563] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=22] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399797840102000, snapshot_type=1, create_time=1734399797905534, addr="192.168.159.138:2882", gc_status=0) [2024-12-16 17:49:16.548574] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=9] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399917859012000, snapshot_type=1, create_time=1734399917857587, addr="192.168.159.139:2882", gc_status=0) [2024-12-16 17:49:16.548584] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734400025484108000, snapshot_type=1, create_time=1734400025476333, addr="192.168.159.141:2882", gc_status=0) [2024-12-16 17:49:16.548594] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734400040870509000, snapshot_type=1, create_time=1734400040830721, addr="192.168.159.142:2882", gc_status=0) [2024-12-16 17:49:16.548603] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399697685048000, snapshot_type=1, create_time=1734399697687355, addr="192.168.159.143:2882", gc_status=0) [2024-12-16 17:49:16.548612] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399855756303001, snapshot_type=2, create_time=1734399856255234, addr="192.168.159.137:2882", gc_status=0) [2024-12-16 17:49:16.548621] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399797552807000, snapshot_type=2, create_time=1734399797905534, addr="192.168.159.138:2882", gc_status=0) [2024-12-16 17:49:16.548630] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399917645937000, snapshot_type=2, create_time=1734399917857587, addr="192.168.159.139:2882", gc_status=0) [2024-12-16 17:49:16.548701] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=66] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734400025216922000, snapshot_type=2, create_time=1734400025476333, addr="192.168.159.141:2882", gc_status=0) [2024-12-16 17:49:16.548711] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=9] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734400040308871001, snapshot_type=2, create_time=1734400040830721, addr="192.168.159.142:2882", gc_status=0) [2024-12-16 17:49:16.548720] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399697335343000, snapshot_type=2, create_time=1734399697687355, addr="192.168.159.143:2882", gc_status=0) [2024-12-16 17:49:16.548729] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399856166864000, snapshot_type=3, create_time=1734399856255234, addr="192.168.159.137:2882", gc_status=0) [2024-12-16 17:49:16.548738] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399797752844000, snapshot_type=3, create_time=1734399797905534, addr="192.168.159.138:2882", gc_status=0) [2024-12-16 17:49:16.548747] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399917845747000, snapshot_type=3, create_time=1734399917857587, addr="192.168.159.139:2882", gc_status=0) [2024-12-16 17:49:16.548756] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734400025442138000, snapshot_type=3, create_time=1734400025476333, addr="192.168.159.141:2882", gc_status=0) [2024-12-16 17:49:16.548765] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734400040741087000, snapshot_type=3, create_time=1734400040830721, addr="192.168.159.142:2882", gc_status=0) [2024-12-16 17:49:16.548774] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1734399697402309000, snapshot_type=3, create_time=1734399697687355, addr="192.168.159.143:2882", gc_status=0) [2024-12-16 17:49:16.548782] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1734399856255234, addr="192.168.159.137:2882", gc_status=0) [2024-12-16 17:49:16.548791] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1734399797905534, addr="192.168.159.138:2882", gc_status=0) [2024-12-16 17:49:16.548800] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1734399917857587, addr="192.168.159.139:2882", gc_status=0) [2024-12-16 17:49:16.548809] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1734400025476333, addr="192.168.159.141:2882", gc_status=0) [2024-12-16 17:49:16.548818] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1734400040830721, addr="192.168.159.142:2882", gc_status=0) [2024-12-16 17:49:16.548827] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=7] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1734399697687355, addr="192.168.159.143:2882", gc_status=0) [2024-12-16 17:49:16.549038] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=8] succeed to update global reserved snapshot(ret=0, this={this:0x2b45985b0f30, last_study_timestamp:1734399856262338, last_refresh_timestamp:1734400096524324, last_reclaim_timestamp:1734399856266437, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1734399697335343000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1734399697335343000, v:0}, reserved_snapshot={val:1734399697335343000, v:0}) [2024-12-16 17:49:16.549059] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=20] multi-version garbage collector refresh successfully(this={this:0x2b45985b0f30, last_study_timestamp:1734399856262338, last_refresh_timestamp:1734400096524324, last_reclaim_timestamp:1734399856266437, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1734399697335343000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1734399697335343000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1734399697687355, reserved_addr:"192.168.159.143:2882", is_this_server_disabled:false, status:0}) [2024-12-16 17:49:16.549077] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=17] repeat refresh successfully(ret=0, this={this:0x2b45985b0f30, last_study_timestamp:1734399856262338, last_refresh_timestamp:1734400156549076, last_reclaim_timestamp:1734399856266437, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1734399697335343000, v:0}, is_inited:true}, current_timestamp=1734400156546046, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2024-12-16 17:49:16.549088] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [128749][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=11] skip repeat reclaim(ret=0, this={this:0x2b45985b0f30, last_study_timestamp:1734399856262338, last_refresh_timestamp:1734400156549076, last_reclaim_timestamp:1734399856266437, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1734399697335343000, v:0}, is_inited:true}, current_timestamp=1734400156549088, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2024-12-16 17:49:16.553129] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [129898][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=96] start do ls ha handler(ls_id_array_=[{id:1}, {id:1002}, {id:1001}]) [2024-12-16 17:49:16.562349] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [128881][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=158] current monitor number(seq_=-1) [2024-12-16 17:49:16.572689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=5) [2024-12-16 17:49:16.584460] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [129967][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=151] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):512, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):512, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):206, sequence:1}) [2024-12-16 17:49:16.592263] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1565) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963E7EFC6E2-0-0] [lt=11] receive register_req from acceptor, ignore(self="192.168.159.137:2882", palf_id=1001, child={server:"192.168.159.139:2882", region:"sys_region", register_time_us:1734400156657072, keepalive_ts:-1}) [2024-12-16 17:49:16.592298] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1584) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963E7EFC6E2-0-0] [lt=33] handle_register_parent_req finished(ret=0, ret="OB_SUCCESS", palf_id=1001, self="192.168.159.137:2882", child={server:"192.168.159.139:2882", region:"sys_region", register_time_us:1734400156657072, keepalive_ts:-1}, is_to_leader=true) [2024-12-16 17:49:16.597433] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-000629641FA3C0CB-0-0] [lt=51][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100603, send_timestamp=1734400156496827, peer="192.168.159.142:50522", sz=239) [2024-12-16 17:49:16.597918] INFO [STORAGE] runTimerTask (ob_ddl_heart_beat_task.cpp:49) [128459][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=26] send to rs all task status succeed [2024-12-16 17:49:16.598294] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629641F95ACCB-0-0] [lt=140][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100493, send_timestamp=1734400156497799, peer="192.168.159.142:49916", sz=265) [2024-12-16 17:49:16.599169] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629641FA3C0CC-0-0] [lt=25][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100633, send_timestamp=1734400156498534, peer="192.168.159.142:49912", sz=240) [2024-12-16 17:49:16.600519] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641FA3C0CD-0-0] [lt=22][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100452, send_timestamp=1734400156500065, peer="192.168.159.142:49904", sz=240) [2024-12-16 17:49:16.616161] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128769][T1_L5_G0][T1][YB42C0A89F8D-000629641B3899BA-0-0] [lt=96] get number(ret=0, service_type_=0, range=1, base_id=1734400156615127000, start_id=1734400156615127000, end_id=1734400156615127001) [2024-12-16 17:49:16.632194] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [128462][ServerTracerTim][T0][YB42C0A89F89-00062963DE83797C-0-0] [lt=181] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-12-16 17:49:16.635107] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.637379] WDIAG begin (ob_hashtable.h:954) [128853][T1_L0_G0][T1][YB42C0A89F8E-000629641EE2077B-0-0] [lt=60][errcode=-4006] hashtable not init, backtrace=0x7bcec65 0x10e56fc4 0x10c3334e 0x127d5d5e 0x128943bc 0x79a8fba 0x7b14b1e 0x7b14a62 0x7b14a62 0x7b1436d 0x7a43500 0x7a356ac 0x7a348d8 0x7a344f4 0x11dd5114 0x7a3376f 0x7a2ba1e 0x7a26ade 0x7a155ee 0x76c8f84 0x76c547e 0x1287b4fd 0x108aab76 0x108aa665 0x7be5a58 0x74c49cc 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d [2024-12-16 17:49:16.640189] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [128853][T1_L0_G0][T1][YB42C0A89F8E-000629641EE2077B-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=168638199587, cache_obj->added_lc()=false, cache_obj->get_object_id()=95449, cache_obj->get_tenant_id()=1, lbt()="0x7bcec65 0xfb1dce8 0x750765e 0xfa904bd 0xf0e183a 0xefff187 0x74c3b9f 0x74b3b63 0xe9ade57 0x1f6278be 0x2b456c0fbea5 0x2b456c40e96d") [2024-12-16 17:49:16.645676] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=32212254, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=16637952) [2024-12-16 17:49:16.645710] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] Construct Queue Num(construct_num=0, get_push_idx()=73, get_cur_idx()=65, get_pop_idx()=65) [2024-12-16 17:49:16.665447] INFO [LIB] stat (utility.h:1176) [129797][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=105] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2552, this=0x2b463a425bb0, extra_info="palf_id:1002") [2024-12-16 17:49:16.665503] INFO [LIB] stat (utility.h:1193) [129797][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=256, this=0x2b45db5f93b0, extra_info="") [2024-12-16 17:49:16.666484] INFO [LIB] stat (utility.h:1176) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x2b463a425de0, extra_info="palf_id:1002") [2024-12-16 17:49:16.676117] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=103079214, evict_high_size_level=530841, evict_batch_count=0, elapse_time=0, size_used=65536, mem_used=97747968) [2024-12-16 17:49:16.676152] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] Construct Queue Num(construct_num=0, get_push_idx()=29, get_cur_idx()=21, get_pop_idx()=20) [2024-12-16 17:49:16.678489] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1565) [129287][T1001_L0_G1][T1001][YB42C0A89F8B-00062963E60F7748-0-0] [lt=13] receive register_req from acceptor, ignore(self="192.168.159.137:2882", palf_id=1, child={server:"192.168.159.139:2882", region:"sys_region", register_time_us:1734400156742484, keepalive_ts:-1}) [2024-12-16 17:49:16.678566] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1584) [129287][T1001_L0_G1][T1001][YB42C0A89F8B-00062963E60F7748-0-0] [lt=75] handle_register_parent_req finished(ret=0, ret="OB_SUCCESS", palf_id=1, self="192.168.159.137:2882", child={server:"192.168.159.139:2882", region:"sys_region", register_time_us:1734400156742484, keepalive_ts:-1}, is_to_leader=true) [2024-12-16 17:49:16.693478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1430695936, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:16.698540] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-000629641F95ACCC-0-0] [lt=30][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100510, send_timestamp=1734400156598026, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:16.703987] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-0006296423659FA4-0-0] [lt=21][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100540, send_timestamp=1734400156603445, peer="192.168.159.142:49916", sz=265) [2024-12-16 17:49:16.714462] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [128751][T1_DBMSSched][T1][YB42C0A89F89-00062963E093C17F-0-0] [lt=22] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2024-12-16 17:49:16.718242] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:16.718327] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=83][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:16.721888] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=23] worker thread began to shrink(tenant_->id()=1, group_id_=1, token=0) [2024-12-16 17:49:16.722377] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129259][T1_L0_G1][T1][Y0-0000000000000000-0-0] [lt=60] worker thread exit(tenant_->id()=1, workers_.get_size()=7) [2024-12-16 17:49:16.722417] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129259][T1_L0_G1][T0][Y0-0000000000000000-0-0] [lt=34] tenant thread end_run(id_=1, ret=0, thread_count_=192) [2024-12-16 17:49:16.725212] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=7][errcode=-4152] get obj error(ret=-4152) [2024-12-16 17:49:16.725231] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [129807][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2024-12-16 17:49:16.735133] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.744027] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128728][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1734400156740940000, start_id=1734400156740940000, end_id=1734400156740940001) [2024-12-16 17:49:16.756906] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT GROUP LOG INFO](palf_id=1001, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-12-16 17:49:16.756936] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"192.168.159.137:2882", has_set_deleted:false}, append size=1211) [2024-12-16 17:49:16.770256] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129275][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF52C-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="192.168.159.137:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=60, avg_log_submit_to_flush_time=3451, avg_log_submit_to_slide_time=7753) [2024-12-16 17:49:16.770364] INFO [PALF] read (log_cache.cpp:103) [129800][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:16.772898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=4) [2024-12-16 17:49:16.778292] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129964][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=9200) [2024-12-16 17:49:16.781227] INFO [PALF] read (log_cache.cpp:103) [129966][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9200, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:16.794548] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=41] worker thread began to shrink(tenant_->id()=1001, group_id_=1, token=0) [2024-12-16 17:49:16.795843] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129280][T1001_L0_G1][T1001][Y0-0000000000000000-0-0] [lt=18] worker thread exit(tenant_->id()=1001, workers_.get_size()=4) [2024-12-16 17:49:16.795889] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129280][T1001_L0_G1][T0][Y0-0000000000000000-0-0] [lt=39] tenant thread end_run(id_=1001, ret=0, thread_count_=137) [2024-12-16 17:49:16.800017] INFO do_work (ob_rl_mgr.cpp:705) [128504][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=24] swc wakeup.(stat_period_=1000000, ready=false) [2024-12-16 17:49:16.804268] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-0006296423659FA5-0-0] [lt=22][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100652, send_timestamp=1734400156703613, peer="192.168.159.142:49912", sz=265) [2024-12-16 17:49:16.813834] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-0006296424B5A14D-0-0] [lt=41][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100540, send_timestamp=1734400156713289, peer="192.168.159.142:49904", sz=265) [2024-12-16 17:49:16.835343] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=105][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.849276] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [128682][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-12-16 17:49:16.851084] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128682][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] get number(ret=0, service_type_=0, range=1, base_id=1734400156848930000, start_id=1734400156848930000, end_id=1734400156848930001) [2024-12-16 17:49:16.857938] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=33] worker thread began to shrink(tenant_->id()=1002, group_id_=1, token=0) [2024-12-16 17:49:16.860495] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [129275][T1002_L0_G1][T1002][Y0-0000000000000000-0-0] [lt=29] worker thread exit(tenant_->id()=1002, workers_.get_size()=7) [2024-12-16 17:49:16.860524] INFO [SHARE] end_run (ob_tenant_base.cpp:333) [129275][T1002_L0_G1][T0][Y0-0000000000000000-0-0] [lt=23] tenant thread end_run(id_=1002, ret=0, thread_count_=201) [2024-12-16 17:49:16.875754] INFO [STORAGE] try_shrink (ob_compaction_memory_pool.cpp:522) [128678][T1_MergeMemPool][T1][Y0-0000000000000000-0-0] [lt=21] Compaction Mem Pool current stat: (ret=0, max_block_num=16, total_block_num=8, Chunk list size: =1) [2024-12-16 17:49:16.894234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=100] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1430695936, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:16.894939] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [129906][T1002_DBMSSched][T1002][YB42C0A89F89-00062963EB03C84E-0-0] [lt=129] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2024-12-16 17:49:16.896303] INFO eloop_run (eloop.c:140) [128494][pnio2][T0][Y0-0000000000000000-0-0] [lt=119] PNIO [ratelimit] time: 1734400156896300, bytes: 0, bw: 0.000000 MB/s, add_ts: 1001705, add_bytes: 0 [2024-12-16 17:49:16.896478] INFO [COMMON] process (ob_rpc_processor_simple.cpp:2755) [129241][T1002_L0_G19][T1002][YB42C0A89F8B-00062963E7CF9F2E-0-0] [lt=16] handle ObQueryLSIsValidMember requeset(arg_={tenant_id_:1002, self_addr_:"192.168.159.139:2882", ls_array_:[{id:1}, {id:1001}]}) [2024-12-16 17:49:16.896527] INFO [CLOG] get_member_gc_stat (ob_log_handler.cpp:1619) [129241][T1002_L0_G19][T1002][YB42C0A89F8B-00062963E7CF9F2E-0-0] [lt=42] get_member_gc_stat(is_valid_member=true, stat=1, member_list=3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, learner_list={learner_num:0, learner_array:[]}, addr="192.168.159.139:2882", this={role:1, proposal_id:1, palf_env_:0x2b45db5f2030, is_in_stop_state_:false, is_inited_:true, id_:1}) [2024-12-16 17:49:16.896558] INFO [CLOG] get_member_gc_stat (ob_log_handler.cpp:1619) [129241][T1002_L0_G19][T1002][YB42C0A89F8B-00062963E7CF9F2E-0-0] [lt=28] get_member_gc_stat(is_valid_member=true, stat=1, member_list=3{server:"192.168.159.137:2882", timestamp:1, flag:0}{server:"192.168.159.138:2882", timestamp:1, flag:0}{server:"192.168.159.139:2882", timestamp:1, flag:0}, learner_list={learner_num:0, learner_array:[]}, addr="192.168.159.139:2882", this={role:1, proposal_id:1, palf_env_:0x2b45db5f2030, is_in_stop_state_:false, is_inited_:true, id_:1001}) [2024-12-16 17:49:16.898770] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-000629641F95ACCD-0-0] [lt=38][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100649, send_timestamp=1734400156798117, peer="192.168.159.142:50522", sz=265) [2024-12-16 17:49:16.904754] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-0006296423659FA6-0-0] [lt=58][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100980, send_timestamp=1734400156803769, peer="192.168.159.142:49916", sz=265) [2024-12-16 17:49:16.914123] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-0006296424B5A14E-0-0] [lt=25][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100673, send_timestamp=1734400156813446, peer="192.168.159.142:49912", sz=265) [2024-12-16 17:49:16.915541] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2024-12-16 17:49:16.915586] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=35] temporary file module use no blocks [2024-12-16 17:49:16.915606] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2024-12-16 17:49:16.915628] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1082) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2024-12-16 17:49:16.915724] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [130027][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=93] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:168637474037, flush_io_finished_ret_:0, flush_io_finished_round_:40986, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2024-12-16 17:49:16.919421] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [129891][T1002_ArcSender][T1002][YB42C0A89F89-00062963E5835926-0-0] [lt=38][errcode=-4018] try free send task failed(ret=-4018) [2024-12-16 17:49:16.921239] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [130042][T1001_TenantWea][T1001][YB42C0A89F89-00062963E5EC5365-0-0] [lt=15] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.156114959716796875e+01, this=0x2b45fe857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=357, Throttle Trigger(MB)=214, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.068143388453214129e+03) [2024-12-16 17:49:16.921617] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [128568][TsMgr][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1734400156919194000, start_id=1734400156919194000, end_id=1734400156919194001) [2024-12-16 17:49:16.921712] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [128568][TsMgr][T1][Y0-0000000000000000-0-0] [lt=88] ts response task statistics(alloc_count=984946, free_count=492472) [2024-12-16 17:49:16.926804] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [129813][T1002_BalanceEx][T1002][YB42C0A89F89-00062963EBF3F8BE-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-12-16 17:49:16.926975] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [129813][T1002_BalanceEx][T1002][YB42C0A89F89-00062963EBF3F8BE-0-0] [lt=45] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-12-16 17:49:16.935524] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:16.943123] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=11] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=12478464) [2024-12-16 17:49:16.943159] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [130041][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] Construct Queue Num(construct_num=0, get_push_idx()=70, get_cur_idx()=62, get_pop_idx()=62) [2024-12-16 17:49:16.943768] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=8] ====== checkpoint timer task ====== [2024-12-16 17:49:16.944685] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] succ to get rec scn(*this={this:0x2b45ed604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:2, v:0}, max_applied_start_working_ts_:{val:2, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1734359134556381, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-12-16 17:49:16.944730] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=106] tx ctx memtable get rec scn(this={ObITable:{this:0x2b45c8696080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x2b45c8696080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-12-16 17:49:16.944859] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1734387539611138001, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:226}, rec_scn:{val:1734387539611138001, v:0}}, }, *this={this:0x2b460dfa4510, is_inited:true, freezing_scn:{val:1734377672394781001, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734387451893035000, v:0}, clog_base_lsn:{lsn:268419072}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1734359152843519000, v:0}, all_id_meta:{id_meta:[{limited_id:1734400170422253000, latest_log_ts:{val:1734400153830905001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734365294344570001, v:0}}, {limited_id:60000001, latest_log_ts:{val:1734374865140781001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b46037aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-12-16 17:49:16.944984] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=120] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x2b460dfb1e10}, min_rec_scn={val:1734387451893035000, v:0}, ls_id_={id:1}) [2024-12-16 17:49:16.945004] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-12-16 17:49:16.945018] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=0, rec_log_ts={val:1734400153830905001, v:0}) [2024-12-16 17:49:16.945026] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=7] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-12-16 17:49:16.945033] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=6] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-12-16 17:49:16.945045] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=5] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-12-16 17:49:16.945063] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-12-16 17:49:16.945076] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=10] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1734387451893035000, v:0}, checkpoint_scn_in_ls_meta={val:1734387451893035000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-12-16 17:49:16.945095] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=9][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:268419072}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:268419072}, lsn={lsn:268419072}) [2024-12-16 17:49:16.945116] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:268419072}, ls->get_ls_id()={id:1}) [2024-12-16 17:49:16.945126] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [130043][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=8] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-12-16 17:49:16.945728] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [130007][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=68] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:887, free_obj_hold_cnt:72, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:72, free_obj_hold_cnt:6, allocator used:5116098, allocator total:5116098}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():174592, full allocator used:1600, full allocator total:240128}, tablets_mem=9273026, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:27, free_obj_hold_cnt:50, allocator used:157696, allocator total:195840}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2024-12-16 17:49:16.953458] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:150) [128742][T1_CompactionRe][T1][YB42C0A89F89-00062963E1935F12-0-0] [lt=88] TabletUpdaterRefreshTask(cost_ts=4) [2024-12-16 17:49:16.965422] INFO [CLOG] handle_submit_task_ (ob_log_replay_service.cpp:1291) [129912][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=31] succ to submit log task to replay service(to_submit_lsn={lsn:49715995}, to_submit_scn={val:1734400156910003000, v:0}, replay_status={ls_id_:{id:1002}, is_enabled_:true, is_submit_blocked_:false, role_:2, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:1, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1734400156965242, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:49716061}, next_to_submit_scn_:{val:1734400156910003001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1734359202110029000, v:0}, iterator_:{iterator_impl:{buf_:0x2b4636cf7000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:49715939}, end_lsn:{lsn:49716061}, read_buf:{buf_len_:73728, buf_:0x2b4636cf7000}, block_size:67104768, log_storage_:0x2b463a421a30, log_storage_:{log_tail:{lsn:49716061}, readable_log_tail:{lsn:49716061}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1734359202110029001, v:0}, curr_block_id:0, palf_id:1002}, block_mgr:{log_dir:"/ob/data/clog/tenant_1002/1002/log", dir_fd:181, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:17388707, block_header_serialize_buf_:0x2b463a4226b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1734400156910003000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1734400156910003000, v:0}, data_checksum:3348837161, flag:31848}}, init_mode_version:0, accumulate_checksum:3134332065, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1734400156910003000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:407627, miss_cnt:0, cache_read_size:49716061, hit_ratio:"1.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:0, read_io_size:0, read_disk_cost_ts:0, start_lsn:{lsn:0}}}}}}) [2024-12-16 17:49:16.973033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=3) [2024-12-16 17:49:16.981119] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641F33D3E1-0-0] [lt=38][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1808, fly_ts=104009, send_timestamp=1734400156877107, peer="192.168.159.142:49904", sz=256) [2024-12-16 17:49:16.981312] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [128685][T1_HBService][T1][YB42C0A89F89-00062963E023AA06-0-0] [lt=14] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-12-16 17:49:16.988736] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [129989][T1001_Occam][T1001][YB42C0A89F89-00062963ED135927-0-0] [lt=8] ====== tenant freeze timer task ====== [2024-12-16 17:49:16.988781] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [129989][T1001_Occam][T1001][YB42C0A89F89-00062963ED135927-0-0] [lt=37] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=58720256, ctx.total_memstore_used_=92274688, ctx.total_memstore_hold_=92274688, memstore_freeze_trigger_limit_=64757740, tenant_id=1001) [2024-12-16 17:49:16.988801] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [129989][T1001_Occam][T1001][YB42C0A89F89-00062963ED135927-0-0] [lt=15] [TenantFreezer] oldest frozen memtable(list="") [2024-12-16 17:49:17.008097] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [128788][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=11] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1734362437313536, tenant_id:1002, sequence_id:1099511630452}) [2024-12-16 17:49:17.008132] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [128788][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=34] try reload schema success(schema_version=1734362366739016, refresh_schema_info={schema_version:1734362437313536, tenant_id:1002, sequence_id:1099511630452}, schema_ret=0) [2024-12-16 17:49:17.008163] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [128506][SerScheQueue0][T0][YB42C0A89F89-00062963E0C38174-0-0] [lt=22] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1734362437313536, tenant_id:1002, sequence_id:1099511630452}) [2024-12-16 17:49:17.008190] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [128506][SerScheQueue0][T0][YB42C0A89F89-00062963E0C38174-0-0] [lt=23] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1734362437313536, tenant_id:1002, sequence_id:1099511630452}, schema_info={schema_version:1734362437313536, tenant_id:1002, sequence_id:1099511630452}) [2024-12-16 17:49:17.008810] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-000629642440BF53-0-0] [lt=88][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=100929, send_timestamp=1734400156907877, peer="192.168.159.142:50522", sz=1634) [2024-12-16 17:49:17.019425] INFO [SHARE] create_user_ls (ob_ls_creator.cpp:167) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=74] start to create log stream(id={id:1003}, tenant_id=1002) [2024-12-16 17:49:17.030058] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=14][errcode=-4152] get int failed(name="major_refresh_mv_merge_scn", ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:17.030110] WDIAG [SHARE] get_major_refresh_mv_merge_scn (ob_global_stat_proxy.cpp:329) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=49][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2024-12-16 17:49:17.030122] INFO [SHARE] check_tenant_mv_merge_info_ (ob_ls_creator.cpp:460) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=12] create ls with merge info(ret=0, ret="OB_SUCCESS", major_mv_merge_info={major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:17.030677] INFO [STORAGE] create_ls (ob_ls_service.cpp:500) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=21] create_ls begin(arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:17.030755] WDIAG [STORAGE] get_ls (ob_ls_service.cpp:977) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=71][errcode=-4719] get log stream fail(ret=-4719, ls_id={id:1003}) [2024-12-16 17:49:17.030780] WDIAG [STORAGE] check_tenant_ls_num_ (ob_ls_service.cpp:404) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=14][errcode=-4720] too many ls of a tenant(ret=-4720, normal_ls_count=3, removeing_ls_count=0, min_constraint_type=5, get_constraint_type_name(min_constraint_type)="clog_disk", min_constraint_value=3) [2024-12-16 17:49:17.030815] WDIAG [STORAGE] create_ls_ (ob_ls_service.cpp:1287) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=18][errcode=-4720] too many ls(ret=-4720) [2024-12-16 17:49:17.030823] WDIAG [STORAGE] create_ls (ob_ls_service.cpp:525) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=7][errcode=-4720] create ls failed(ret=-4720, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:17.030848] INFO [STORAGE] create_ls (ob_ls_service.cpp:533) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=24] create_ls finish(ret=-4720, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:17.030878] WDIAG [COMMON] process (ob_rpc_processor_simple.cpp:1596) [129935][T1002_L0_G0][T1002][YB42C0A89F89-00062963EC13F404-0-0] [lt=27][errcode=-4720] failed create log stream(ret=-4720, ret="OB_TOO_MANY_TENANT_LS", arg_=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}) [2024-12-16 17:49:17.032370] WDIAG [RPC] wait (ob_async_rpc_proxy.h:453) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=16][errcode=0] execute rpc failed(rc=-4720, server="192.168.159.137:2882", timeout=29993183, packet code=2338, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}, ret=0) [2024-12-16 17:49:17.032451] WDIAG [RPC] wait (ob_async_rpc_proxy.h:453) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=74][errcode=0] execute rpc failed(rc=-4720, server="192.168.159.138:2882", timeout=29993143, packet code=2338, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}, ret=0) [2024-12-16 17:49:17.032484] WDIAG [RPC] wait (ob_async_rpc_proxy.h:453) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=32][errcode=0] execute rpc failed(rc=-4720, server="192.168.159.139:2882", timeout=29993129, packet code=2338, arg=tenant_id:1002, id:{id:1003}, replica_type:0, replica_property:{memstore_percent_:100}, tenant_info:{tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn:{val:1734359202119679000, v:0}, compat_mode:0, palf_base_info:{prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, create with palf:false, major_mv_merge_info:{major_mv_merge_scn:{val:0, v:0}, major_mv_merge_scn_safe_calc:{val:0, v:0}, major_mv_merge_scn_publish:{val:0, v:0}}, ret=0) [2024-12-16 17:49:17.032511] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:681) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=23][errcode=0] rpc is failed(ret=0, ret="OB_SUCCESS", return_code_array.at(i)=-4720, i=0) [2024-12-16 17:49:17.032520] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:681) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=9][errcode=0] rpc is failed(ret=0, ret="OB_SUCCESS", return_code_array.at(i)=-4720, i=1) [2024-12-16 17:49:17.032526] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:681) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=6][errcode=0] rpc is failed(ret=0, ret="OB_SUCCESS", return_code_array.at(i)=-4720, i=2) [2024-12-16 17:49:17.032533] WDIAG [SHARE] check_create_ls_result_ (ob_ls_creator.cpp:733) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=5][errcode=-4672] success count less than majority(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", paxos_replica_num=3, member_list=0) [2024-12-16 17:49:17.032594] INFO [SHARE] add_event (ob_event_history_table_operator.h:266) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=8] event table add task(ret=0, event_table_name="__all_rootservice_event_history", sql=INSERT INTO __all_rootservice_event_history (gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, rs_svr_ip, rs_svr_port) VALUES (usec_to_time(1734400157032544), 'LS', 'create_ls', 'tenant_id', 1002, 'ls_id', '{id:1003}', 'ret', -4672, 'success_cnt', '0', 'paxos_cnt', 3, '', 0, X'74726163655F69643A5942343243304138394638392D303030363239363345433133463430342D302D30', '192.168.159.137', 2882)) [2024-12-16 17:49:17.032720] WDIAG [SHARE] create_ls_ (ob_ls_creator.cpp:554) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=121][errcode=-4672] failed to check ls result(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", paxos_replica_num=3, return_code_array=[-4720, -4720, -4720], learner_list={learner_num:0, learner_array:[]}, need_create_arb_replica=false, arb_replica_count=0) [2024-12-16 17:49:17.032741] WDIAG [SHARE] do_create_ls_ (ob_ls_creator.cpp:383) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=17][errcode=-4672] failed to create log stream(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", id={id:1003}, tenant_id=1002, create_with_palf=false, addr=[{addr:"192.168.159.137:2882", replica_type:0}, {addr:"192.168.159.138:2882", replica_type:0}, {addr:"192.168.159.139:2882", replica_type:0}], paxos_replica_num=3, tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1734400155416071000, replayable_scn:1734400155416071000, readable_scn:1734359204309426002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1003, restore_data_mode:{restore data mode:"NORMAL"}}, create_scn={val:1734359202119679000, v:0}, compat_mode=0, palf_base_info={prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}, learner_list={learner_num:0, learner_array:[]}) [2024-12-16 17:49:17.032775] WDIAG [SHARE] create_user_ls (ob_ls_creator.cpp:219) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=31][errcode=-4672] failed to create log stream(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", id={id:1003}, tenant_id=1002, addr=[{addr:"192.168.159.137:2882", replica_type:0}, {addr:"192.168.159.138:2882", replica_type:0}, {addr:"192.168.159.139:2882", replica_type:0}], paxos_replica_num=3, status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"CREATING", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, create_scn={val:1734359202119679000, v:0}, palf_base_info={prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}, curr_lsn:{lsn:18446744073709551615}}) [2024-12-16 17:49:17.032803] INFO [SHARE] create_user_ls (ob_ls_creator.cpp:223) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=25] finish to create log stream(ret=-4672, ret="OB_REPLICA_NUM_NOT_ENOUGH", id={id:1003}, tenant_id=1002, cost=13379) [2024-12-16 17:49:17.032845] INFO [SHARE] add_event (ob_event_history_table_operator.h:266) [129975][T1001_COMMONLSS][T1001][YB42C0A89F89-00062963EC13F404-0-0] [lt=9] event table add task(ret=0, event_table_name="__all_rootservice_event_history", sql=INSERT INTO __all_rootservice_event_history (gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, rs_svr_ip, rs_svr_port) VALUES (usec_to_time(1734400157032814), 'LS', 'create_ls_finish', 'tenant_id', 1002, 'ls_id', '{id:1003}', 'ret', -4672, 'success_cnt', '', 'paxos_cnt', 3, '', 0, X'636F73743A31333337392C2074726163655F69643A5942343243304138394638392D303030363239363345433133463430342D302D30', '192.168.159.137', 2882)) [2024-12-16 17:49:17.034452] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [128529][EvtHisUpdTask][T1][YB42C0A89F89-00062963DF36E062-0-0] [lt=119] adaptive update(Tenant ID=1, Config Specify Resource Limit(MB)=1023, TxShare Current Memory Limit(MB)=894, Holding Memory(MB)=127, Tenant Remain Memory(MB)=1278, Usable Remain Memory(MB)=767, Last Update Limit Timestamp=1734400157031687, Is Updated=true) [2024-12-16 17:49:17.035689] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:17.040782] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [130046][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=11] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-12-16 17:49:17.040806] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [130046][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=17] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-12-16 17:49:17.040819] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [130046][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=10] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=8198) [2024-12-16 17:49:17.049781] INFO [SHARE] pre_run (ob_tenant_base.cpp:319) [129292][][T1][Y0-0000000000000000-0-0] [lt=0] tenant thread pre_run(MTL_ID()=1, ret=0, thread_count_=193) [2024-12-16 17:49:17.049888] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [129292][][T1][Y0-0000000000000000-0-0] [lt=49] Init thread local success [2024-12-16 17:49:17.050437] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:509) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=26] worker thread created(tenant_->id()=1, group_id_=1, token=1) [2024-12-16 17:49:17.052094] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128571][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:17.052801] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128569][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:17.053576] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128570][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:17.053710] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [128572][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-12-16 17:49:17.057130] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=58, this=0x2b46342ef470, extra_info="") [2024-12-16 17:49:17.057204] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x2b46342d1410, extra_info="id:1001") [2024-12-16 17:49:17.058912] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="192.168.159.137:2882", committed size=1211) [2024-12-16 17:49:17.069768] INFO [PALF] read (log_cache.cpp:103) [129916][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT HOT CACHE HIT RATE](palf_id=1002, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:17.069763] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129229][T1002_L0_G1][T1002][YB42C0A89F89-00062963EB39C42B-0-0] [lt=38] [PALF STAT LOG TASK TIME](palf_id=1002, self="192.168.159.137:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=0, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=2514, avg_log_submit_to_slide_time=32626) [2024-12-16 17:49:17.069821] INFO [PALF] next (palf_iterator.h:183) [129916][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT ITERATOR INFO](io_ctx={user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:407628, miss_cnt:0, cache_read_size:49716183, hit_ratio:"1.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:0, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:0, read_io_size:0, read_disk_cost_ts:0, start_lsn:{lsn:0}}}) [2024-12-16 17:49:17.070913] INFO [OCCAM] get_idx (ob_occam_time_guard.h:223) [129292][T1_L0_G1][T1][YB42C0A89F8B-00062963EF1F82FC-0-0] [lt=10] init point thread id with(&point=0x55b81b081100, idx_=2316, point=[thread id=129292, timeout ts=16:00:00.0, last click point="(null):(null):0", last click ts=16:00:00.0], thread_id=129292) [2024-12-16 17:49:17.089272] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [128731][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=56] ====== check clog disk timer task ====== [2024-12-16 17:49:17.089318] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [128731][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=2048, used(MB):=429) [2024-12-16 17:49:17.095013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [128478][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-1430695936, global_cache_size=1027899392, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2024-12-16 17:49:17.098994] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-000629641F95ACCF-0-0] [lt=87][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=100546, send_timestamp=1734400156998445, peer="192.168.159.142:49916", sz=265) [2024-12-16 17:49:17.102098] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128491][pnio1][T0][YB42C0A89F8E-000629641FA3C0CE-0-0] [lt=46][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100521, send_timestamp=1734400157001575, peer="192.168.159.142:49912", sz=239) [2024-12-16 17:49:17.103297] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128492][pnio1][T0][YB42C0A89F8E-000629641FA3C0CF-0-0] [lt=45][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1315, fly_ts=100472, send_timestamp=1734400157002823, peer="192.168.159.142:49904", sz=240) [2024-12-16 17:49:17.117841] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=28] [COMPACTION DAG STATUS] (start_time=1734400147107219, end_time=1734400157117837, dag_status={}) [2024-12-16 17:49:17.117897] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=52] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117915] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117924] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117939] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117947] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117955] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117969] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2833) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-12-16 17:49:17.117977] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.117989] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118012] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118021] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118036] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118043] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118050] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118058] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118071] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118083] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118095] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118111] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118122] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118133] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118141] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118185] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118200] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118213] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118228] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118238] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118250] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118263] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118271] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118278] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=6] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118288] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118300] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118329] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118341] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118349] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118374] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118394] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118404] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118411] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118489] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=77] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118498] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118520] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118527] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118534] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118542] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118570] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118582] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118590] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118598] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118606] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118614] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118621] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118628] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=75] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118718] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118734] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118749] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118769] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118777] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118785] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4296) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-12-16 17:49:17.118801] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3607) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-12-16 17:49:17.118808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-12-16 17:49:17.118814] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-12-16 17:49:17.118819] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-12-16 17:49:17.118823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-12-16 17:49:17.118827] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-12-16 17:49:17.118832] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-12-16 17:49:17.118836] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-12-16 17:49:17.118841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=5] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-12-16 17:49:17.118845] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3610) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=4] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-12-16 17:49:17.118850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4310) [129999][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=5] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2024-12-16 17:49:17.121829] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1734400156919194000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=202625, in_cluster_service=true, cluster_version={val:1734400156714578000, v:0}, min_cluster_version={val:1734400156714578000, v:0}, max_cluster_version={val:1734400156714578000, v:0}, get_cluster_version_err=0, cluster_version_delta=407241, cluster_service_master="192.168.159.137:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=404847, succ_cluster_heartbeat_count=20, cluster_heartbeat_interval=50000, local_cluster_version={val:1734399572811869000, v:0}, local_cluster_delta=584309950, force_self_check=false, weak_read_refresh_interval=100000) [2024-12-16 17:49:17.124344] INFO [LIB] stat (utility.h:1176) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=154] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=68, this=0x2b460dff1470, extra_info="") [2024-12-16 17:49:17.124391] INFO [LIB] stat (utility.h:1176) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x2b460dfad410, extra_info="id:1") [2024-12-16 17:49:17.126796] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129963][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="192.168.159.137:2882", committed size=8610) [2024-12-16 17:49:17.129036] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=12] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1734400156776661000, v:0}, new_max_version={val:1734400156776661000, v:0}, last_min_version={val:1734400156714578000, v:0}, last_max_version={val:1734400156714578000, v:0}, total_time_us=6928, delta_us=352276) [2024-12-16 17:49:17.129231] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [130042][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=190] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1734400156776661000, v:0}, min_version={val:1734400156776661000, v:0}, max_version={val:1734400156776661000, v:0}, in_service=true, leader_epoch=1) [2024-12-16 17:49:17.132787] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [130044][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=19] ====== traversal_flush timer task ====== [2024-12-16 17:49:17.132960] INFO [MDS] flush (mds_table_mgr.cpp:195) [130044][T1001_Flush][T1001][YB42C0A89F89-00062963E7A37930-0-0] [lt=40] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:226}, rec_scn:{val:1734387539611138001, v:0}}, }, max_consequent_callbacked_scn={val:1734400157123900000, v:0}, *this={this:0x2b460dfa4510, is_inited:true, freezing_scn:{val:1734377672394781001, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1734387451893035000, v:0}, clog_base_lsn:{lsn:268419072}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1734359152843519000, v:0}, all_id_meta:{id_meta:[{limited_id:1734400170422253000, latest_log_ts:{val:1734400153830905001, v:0}}, {limited_id:2000001, latest_log_ts:{val:1734365294344570001, v:0}}, {limited_id:60000001, latest_log_ts:{val:1734374865140781001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x2b46037aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-12-16 17:49:17.133070] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [130044][T1001_Flush][T1001][YB42C0A89F89-00062963E7A37930-0-0] [lt=103] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-12-16 17:49:17.135773] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-12-16 17:49:17.144923] INFO [LIB] stat (utility.h:1176) [128728][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x2b45ac7c5410, extra_info="id:1") [2024-12-16 17:49:17.145900] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=75] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=32212254, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=16637952) [2024-12-16 17:49:17.146102] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [128727][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=195] Construct Queue Num(construct_num=0, get_push_idx()=73, get_cur_idx()=65, get_pop_idx()=65) [2024-12-16 17:49:17.146138] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [129888][T1002_LSArchive][T1002][YB42C0A89F89-00062963E5535926-0-0] [lt=26] gc stale ls task succ [2024-12-16 17:49:17.147425] INFO [LIB] stat (utility.h:1176) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1760, this=0x2b45adc15bb0, extra_info="palf_id:1") [2024-12-16 17:49:17.147477] INFO [LIB] stat (utility.h:1193) [128644][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=647, this=0x2b459aa9d370, extra_info="") [2024-12-16 17:49:17.147692] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [128643][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="192.168.159.137:2882", committed size=6437) [2024-12-16 17:49:17.147734] INFO [LIB] stat (utility.h:1176) [128643][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=28, this=0x2b45adc15de0, extra_info="palf_id:1") [2024-12-16 17:49:17.148490] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1565) [129243][T1002_L0_G1][T1002][YB42C0A89F8A-00062963E7F99A2B-0-0] [lt=9] receive register_req from acceptor, ignore(self="192.168.159.137:2882", palf_id=1, child={server:"192.168.159.138:2882", region:"sys_region", register_time_us:1734400157067592, keepalive_ts:-1}) [2024-12-16 17:49:17.148694] INFO [PALF] handle_register_parent_req (palf_handle_impl.cpp:1584) [129243][T1002_L0_G1][T1002][YB42C0A89F8A-00062963E7F99A2B-0-0] [lt=202] handle_register_parent_req finished(ret=0, ret="OB_SUCCESS", palf_id=1, self="192.168.159.137:2882", child={server:"192.168.159.138:2882", region:"sys_region", register_time_us:1734400157067592, keepalive_ts:-1}, is_to_leader=true) [2024-12-16 17:49:17.149291] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128493][pnio1][T0][YB42C0A89F8E-000629641ED0C0AF-0-0] [lt=24][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1308, fly_ts=107305, send_timestamp=1734400157041963, peer="192.168.159.142:50522", sz=1578) [2024-12-16 17:49:17.149800] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129289][T1_L0_G1][T1][YB42C0A89F8A-00062963E9EBC06F-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="192.168.159.137:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=99, avg_log_submit_to_flush_time=2606, avg_log_submit_to_slide_time=4545) [2024-12-16 17:49:17.149911] INFO [PALF] read (log_cache.cpp:103) [128646][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=128] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=6437, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:17.157145] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=81, this=0x2b461f6c3470, extra_info="") [2024-12-16 17:49:17.157210] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT GROUP LOG INFO](palf_id=1, self="192.168.159.137:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3270, avg_group_log_size=327) [2024-12-16 17:49:17.157228] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, append size=3270) [2024-12-16 17:49:17.157242] INFO [LIB] stat (utility.h:1176) [129899][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x2b461f671410, extra_info="id:1") [2024-12-16 17:49:17.161119] INFO [LIB] stat (utility.h:1176) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=9] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2164, this=0x2b461f6cdbb0, extra_info="palf_id:1") [2024-12-16 17:49:17.161161] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=3270) [2024-12-16 17:49:17.161213] INFO [LIB] stat (utility.h:1193) [129795][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=462, this=0x2b45db5f8530, extra_info="") [2024-12-16 17:49:17.161557] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="192.168.159.137:2882", committed size=3270) [2024-12-16 17:49:17.161627] INFO [LIB] stat (utility.h:1176) [129794][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x2b461f6cdde0, extra_info="palf_id:1") [2024-12-16 17:49:17.162835] INFO [LIB] stat (utility.h:1176) [129243][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF538-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=19, this=0x2b461f6c36a0, extra_info="palf_id:1") [2024-12-16 17:49:17.162869] INFO [LIB] stat (utility.h:1176) [129243][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF538-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5622, this=0x2b461f6c38d0, extra_info="palf_id:1") [2024-12-16 17:49:17.162881] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [129243][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF538-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="192.168.159.137:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=103, avg_log_submit_to_flush_time=2830, avg_log_submit_to_slide_time=5518) [2024-12-16 17:49:17.163014] INFO [PALF] read (log_cache.cpp:103) [129800][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3270, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2024-12-16 17:49:17.163297] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [129797][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1002, self:"192.168.159.137:2882", has_set_deleted:false}, accum_size=1220) [2024-12-16 17:49:17.166750] INFO [LIB] stat (utility.h:1176) [129266][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF539-0-0] [lt=124] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=25, this=0x2b46342ef6a0, extra_info="palf_id:1001") [2024-12-16 17:49:17.166824] INFO [LIB] stat (utility.h:1176) [129266][T1002_L0_G1][T1002][YB42C0A89F8B-00062963EEFFF539-0-0] [lt=73] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6397, this=0x2b46342ef8d0, extra_info="palf_id:1001") [2024-12-16 17:49:17.166991] INFO [LIB] stat (utility.h:1176) [129266][T1002_L0_G1][T1002][YB42C0A89F89-00062963EB39C42C-0-0] [lt=12] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x2b463a41b6a0, extra_info="palf_id:1002") [2024-12-16 17:49:17.167006] INFO [LIB] stat (utility.h:1176) [129266][T1002_L0_G1][T1002][YB42C0A89F89-00062963EB39C42C-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32844, this=0x2b463a41b8d0, extra_info="palf_id:1002") [2024-12-16 17:49:17.173351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [128479][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=172] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=31457, map_replace_skip_count_=2) [2024-12-16 17:49:17.176375] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=11] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=103079214, evict_high_size_level=530841, evict_batch_count=0, elapse_time=0, size_used=65536, mem_used=97747968) [2024-12-16 17:49:17.176409] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [129881][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=30] Construct Queue Num(construct_num=0, get_push_idx()=29, get_cur_idx()=21, get_pop_idx()=20) [2024-12-16 17:49:17.182869] INFO [SHARE] pre_run (ob_tenant_base.cpp:319) [129294][][T1001][Y0-0000000000000000-0-0] [lt=0] tenant thread pre_run(MTL_ID()=1001, ret=0, thread_count_=138) [2024-12-16 17:49:17.182915] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [129294][][T1001][Y0-0000000000000000-0-0] [lt=43] Init thread local success [2024-12-16 17:49:17.183869] INFO [OCCAM] get_idx (ob_occam_time_guard.h:223) [129294][T1001_L0_G1][T1001][YB42C0A89F8B-00062963EEDFC28E-0-0] [lt=11] init point thread id with(&point=0x55b81b081180, idx_=2318, point=[thread id=129294, timeout ts=16:00:00.0, last click point="(null):(null):0", last click ts=16:00:00.0], thread_id=129294) [2024-12-16 17:49:17.184436] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:509) [128629][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=25] worker thread created(tenant_->id()=1001, group_id_=1, token=1) [2024-12-16 17:49:17.188591] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [130048][T1001_LSArchive][T1001][YB42C0A89F89-00062963E5F35926-0-0] [lt=31] gc stale ls task succ [2024-12-16 17:49:17.205005] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [128710][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2024-12-16 17:49:17.205180] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [128710][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2024-12-16 17:49:17.205203] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [128710][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2024-12-16 17:49:17.205228] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1082) [128710][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=2783, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2024-12-16 17:49:17.205264] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [128710][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:168637764169, flush_io_finished_ret_:0, flush_io_finished_round_:41363, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2024-12-16 17:49:17.205422] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [128744][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-12-16 17:49:17.212136] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [128734][T1_LSArchiveMgr][T1][YB42C0A89F89-00062963DDB35926-0-0] [lt=31] gc stale ls task succ [2024-12-16 17:49:17.218182] WDIAG [RPC] create (ob_poc_rpc_server.cpp:141) [128490][pnio1][T0][YB42C0A89F8E-0006296424B5A150-0-0] [lt=43][errcode=0] PNIO packet wait too much time between proxy and server_cb(pcode=1815, fly_ts=103832, send_timestamp=1734400157114345, peer="192.168.159.142:49916", sz=265) [2024-12-16 17:49:17.236045] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [129880][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT")