[2024-06-24 16:58:27.147970] INFO New syslog file info: [address: "172.20.17.86:2882", observer version: OceanBase_CE 4.3.1.0, revision: 100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4, sysname: Linux, os release: 3.10.0-693.el7.x86_64, machine: x86_64, tz GMT offset: 08:00] [2024-06-24 16:58:27.080943] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107340D-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:27.089585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:27.093762] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=193, mem_used=2079744) [2024-06-24 16:58:27.095270] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=18] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:27.096593] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.096632] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.096648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.096657] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.096826] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.096839] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097058] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097084] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097085] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097095] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097108] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097249] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097251] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097633] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097655] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097656] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097686] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097696] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097785] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097795] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097809] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097908] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097919] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097951] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097958] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097958] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.097961] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098090] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098143] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098440] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098548] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098569] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098637] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098639] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098702] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098720] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098786] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.098823] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.099459] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.104807] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073426-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:27.107576] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9540E-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:27.111994] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1385-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:27.114647] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:27.114735] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:27.114895] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:27.114947] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:27.115077] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:27.115136] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:27.115220] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1387-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:27.115677] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219507114820000, start_id=1719219507114820000, end_id=1719219507114820001) [2024-06-24 16:58:27.116139] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=5325) [2024-06-24 16:58:27.116173] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=398, avg_log_submit_to_slide_time=407) [2024-06-24 16:58:27.125726] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=26] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:27.128152] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1397-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:27.128676] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EA-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:27.128703] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EA-0-0] [lt=24] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:27.130440] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8CF-0-0] [lt=13] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:27.130461] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8CF-0-0] [lt=19] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:27.132510] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=16] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:27.143189] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219507142225000, start_id=1719219507142225000, end_id=1719219507142225001) [2024-06-24 16:58:27.148606] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.152049] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:27.152262] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B3-0-0] [lt=26] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219514521932000, latest_log_ts:{val:1719219497937855001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:27.152412] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B3-0-0] [lt=142] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:27.155129] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D89B-0-0] [lt=51][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:27.155709] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219507154778000, start_id=1719219507154778000, end_id=1719219507154778001) [2024-06-24 16:58:27.172076] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073453-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:27.173301] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.174159] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=19] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:27.174182] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D420-0-0] [lt=24] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:27.174900] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073454-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:27.180811] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219507180047000, start_id=1719219507180047000, end_id=1719219507180047001) [2024-06-24 16:58:27.181071] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:27.182881] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=33] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:27.182985] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506784804000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:27.185060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283188490240, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:27.195380] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=14] ====== traversal_flush timer task ====== [2024-06-24 16:58:27.195576] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B3-0-0] [lt=27] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219504319658004, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219513569925000, latest_log_ts:{val:1719219497306852001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:27.195978] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B3-0-0] [lt=147] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219506823836003, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219504319658004, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:27.196088] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B3-0-0] [lt=105] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:27.200819] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=14] gc stale ls task succ [2024-06-24 16:58:27.202982] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219507202185000, start_id=1719219507202185000, end_id=1719219507202185001) [2024-06-24 16:58:27.211772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [408][T1002_SSTableGC][T1002][YB42AC141156-00061B9D9610C1B2-0-0] [lt=22] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217697107332000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217697107332000) [2024-06-24 16:58:27.218987] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D46E-0-0] [lt=33] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:27.219240] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D470-0-0] [lt=26] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:27.226003] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:124) [408][T1002_SSTableGC][T1002][YB42AC141156-00061B9D9610C1B2-0-0] [lt=40] SSTableGCTask(cost_ts=14870) [2024-06-24 16:58:27.227486] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1402-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:27.229615] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=211359, mem_used=436746240) [2024-06-24 16:58:27.232860] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:27.232891] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4740, avg_group_log_size=430) [2024-06-24 16:58:27.232915] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4740) [2024-06-24 16:58:27.232936] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:27.233268] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4740) [2024-06-24 16:58:27.233335] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:27.233363] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=425, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:27.233381] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=25, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:27.248668] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.273357] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.283648] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=32] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:27.289638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:27.299984] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2024-06-24 16:58:27.300028] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=32] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=130) [2024-06-24 16:58:27.300062] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] cannot_recycle_log_size statistics(cannot_recycle_log_size=70206092, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:27.316910] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=11] get number(ret=0, service_type_=0, range=1, base_id=1719219507316033000, start_id=1719219507316033000, end_id=1719219507316033001) [2024-06-24 16:58:27.318954] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=9] ====== tenant freeze timer task ====== [2024-06-24 16:58:27.324468] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219507323436000, start_id=1719219507323436000, end_id=1719219507323436001) [2024-06-24 16:58:27.324515] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:27.324990] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=19] submit log success(service_type_=0, last_id=1719219523569925000, limited_id=1719219523569925000) [2024-06-24 16:58:27.325013] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=22] submit log with lock success(service_type_=0, last_id=1719219523569925000, limited_id=1719219523569925000) [2024-06-24 16:58:27.325042] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=11] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=360, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:27.325437] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=9] update id meta(ret=0, service_type=0, limited_id=1719219523569925000, latest_scn={val:1719219507324493001, v:0}, *this={tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219504319658004, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:27.325522] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=83] handle submit callback(service_type_=0, success=true, used_ts=533, log_ts={val:1719219507324493001, v:0}, limited_id=1719219523569925000) [2024-06-24 16:58:27.325543] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:27.325560] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:27.332101] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10734E2-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219507331895000, start_id=1719219507331895000, end_id=1719219507331895001) [2024-06-24 16:58:27.332508] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95415-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219507331895000, start_id=1719219507331895001, end_id=1719219507331895002) [2024-06-24 16:58:27.341303] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:27.341497] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A146A-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219507341415000, start_id=1719219507341415000, end_id=1719219507341415001) [2024-06-24 16:58:27.341800] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=18] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1003, min_version={val:1719219507142225000, v:0}, base_version={val:1719219506942863000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219507142225000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219507341786, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:27.343268] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219507342472000, start_id=1719219507342472000, end_id=1719219507342472001) [2024-06-24 16:58:27.343822] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1003, new_min_version={val:1719219507142225000, v:0}, new_max_version={val:1719219507142225000, v:0}, last_min_version={val:1719219506942863000, v:0}, last_max_version={val:1719219506942863000, v:0}, total_time_us=1986, delta_us=201596) [2024-06-24 16:58:27.343848] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219507142225000, v:0}, min_version={val:1719219507142225000, v:0}, max_version={val:1719219507142225000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:27.348727] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.353771] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=29] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1719219506822778001, v:0}, base_version={val:1719219506729859000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219506822778001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219507353755, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:27.355793] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219507355141000, start_id=1719219507355141000, end_id=1719219507355141001) [2024-06-24 16:58:27.356228] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=339, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:27.356267] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:27.356302] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=7, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:27.356332] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=404, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:27.356349] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=30, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:27.358474] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:27.358517] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:27.358801] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=5845) [2024-06-24 16:58:27.358853] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=5845) [2024-06-24 16:58:27.358898] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=15, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=434, avg_log_submit_to_slide_time=445) [2024-06-24 16:58:27.373415] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.380912] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219507380435000, start_id=1719219507380435000, end_id=1719219507380435001) [2024-06-24 16:58:27.385547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283182198784, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:27.396345] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073521-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:27.399187] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073522-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:27.403169] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219507402533000, start_id=1719219507402533000, end_id=1719219507402533001) [2024-06-24 16:58:27.403252] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9619, avg_group_log_size=641) [2024-06-24 16:58:27.403279] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9619) [2024-06-24 16:58:27.404852] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14C5-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:27.407713] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073527-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:27.410758] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14CC-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:27.418845] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129562, mem_used=326519808) [2024-06-24 16:58:27.422985] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=28][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:27.424744] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:27.426538] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:27.426649] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506733030000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:27.433358] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=364, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:27.433391] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:27.435725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107353A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:27.438555] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107353B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:27.442976] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107353D-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:27.445954] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:27.446065] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:27.446266] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:27.446335] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:27.446501] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:27.446576] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:27.446692] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A14FC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:27.448786] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.458311] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163799][T1002_TntTransf][T1002][YB42AC141156-00061B9D9190C34E-0-0] [lt=31] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:27.458760] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073541-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:27.459355] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:27.459404] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=454, avg_log_submit_to_slide_time=466) [2024-06-24 16:58:27.466127] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB3C-0-0] [lt=14][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103403557492, cache_obj->added_lc()=false, cache_obj->get_object_id()=9346, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:27.468945] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163796][T1002_TntTransf][T1002][YB42AC141156-00061B9D9160C34E-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:27.473473] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.479355] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:27.484132] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:27.484162] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=21] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1251) [2024-06-24 16:58:27.489724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:27.489727] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1719219507489724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-06-24 16:58:27.495798] WDIAG [OCCAM] dump_statistics (ob_vtable_event_recycle_buffer.h:144) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D435-0-0] [lt=16][errcode=-4006] not init(ret=-4006) [2024-06-24 16:58:27.495853] INFO [MDS] dump_map_holding_item (mds_tenant_service.cpp:466) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D435-0-0] [lt=27] finish scan map holding items(scan_cnt=0) [2024-06-24 16:58:27.496055] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D436-0-0] [lt=14] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:27.499938] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168E92-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:27.503240] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073561-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:27.506535] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=25] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13712, offset=3443522}, end_cursor:ObLogCursor{file_id=1, log_id=13713, offset=3443795}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fc8050, len:1214, log_data_len:273, seq:13712, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:27.510383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D902-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219507509804000, start_id=1719219507509804000, end_id=1719219507509804001) [2024-06-24 16:58:27.510827] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9618) [2024-06-24 16:58:27.510871] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9618) [2024-06-24 16:58:27.510911] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=375, avg_log_submit_to_slide_time=387) [2024-06-24 16:58:27.511547] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13713, offset=3443795}, end_cursor:ObLogCursor{file_id=1, log_id=13714, offset=3444060}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fd0050, len:941, log_data_len:265, seq:13713, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:27.511972] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163798][T1002_TntTransf][T1002][YB42AC141156-00061B9D9180C34E-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:27.512378] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163797][T1002_TntTransf][T1002][YB42AC141156-00061B9D9170C34E-0-0] [lt=33] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:27.513337] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [1312][T1004_DupTbLeas][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:27.513444] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [1312][T1004_DupTbLeas][T1004][Y0-0000000000000000-0-0] [lt=32][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1004 and flag like "%DUPLICATE%", tenant_id=1004, exec_tenant_id=1003, need_member_list=false) [2024-06-24 16:58:27.517141] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1719219507516134000, start_id=1719219507516134000, end_id=1719219507516134001) [2024-06-24 16:58:27.517185] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E91D-0-0] [lt=29] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1719219507517166}) [2024-06-24 16:58:27.517206] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D062-0-0] [lt=22] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:27.517485] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D062-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219507517461, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:27.517519] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D062-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1719219507517166}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219507517461, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:27.519426] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E91D-0-0] [lt=31] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:27.519599] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E91D-0-0] [lt=30][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:27.527325] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=20] start to print blacklist info [2024-06-24 16:58:27.527516] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=30] ls blacklist refresh finish(cost_time=12064) [2024-06-24 16:58:27.543350] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219507542555000, start_id=1719219507542555000, end_id=1719219507542555001) [2024-06-24 16:58:27.543406] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:27.543430] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:27.543815] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=353, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:27.543849] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=14, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:27.543877] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:27.543901] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=410, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:27.543921] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=23, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:27.548844] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.555577] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219507555225000, start_id=1719219507555225000, end_id=1719219507555225001) [2024-06-24 16:58:27.562060] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A156C-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:27.573531] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.575711] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D420-0-0] [lt=27] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:27.580739] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219507580604000, start_id=1719219507580604000, end_id=1719219507580604001) [2024-06-24 16:58:27.581156] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9610) [2024-06-24 16:58:27.586014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283184295936, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:27.603177] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219507602744000, start_id=1719219507602744000, end_id=1719219507602744001) [2024-06-24 16:58:27.603770] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:27.619173] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:27.620281] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:27.648901] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.659109] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=446, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:27.659122] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:27.659140] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1919) [2024-06-24 16:58:27.659168] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=16, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:27.659179] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1919) [2024-06-24 16:58:27.659203] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:27.659221] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=522, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:27.659239] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=500, avg_log_submit_to_slide_time=508) [2024-06-24 16:58:27.659259] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=21, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:27.668025] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=5] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1669) [2024-06-24 16:58:27.668720] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] sql audit evict mem start(request_manager_->get_tenant_id()=1002, evict_low_mem_level=135291469, evict_high_mem_level=180388626, size_used=53202, mem_used=180937728) [2024-06-24 16:58:27.673591] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.683134] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:59961, max_lsn:32418597, max_scn:{val:1719219507372008001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:32418597}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:0}}, last_submit_lsn:{lsn:32418475}, last_submit_end_lsn:{lsn:32418597}, last_submit_log_id:59961, last_submit_log_pid:1, max_flushed_lsn:{lsn:32418475}, max_flushed_end_lsn:{lsn:32418597}, max_flushed_log_pid:1, committed_end_lsn:{lsn:32418597}, last_slide_log_id:59961, last_slide_scn:{val:1719219507372008001, v:0}, last_slide_lsn:{lsn:32418475}, last_slide_end_lsn:{lsn:32418597}, last_slide_log_pid:1, last_slide_log_accum_checksum:1466152878, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4753cb2530}, [StateMgr]={this:0x7f4753cb62b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:59962, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213336021808, palf_role_change_cb:0x7f4753cbccb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4753cb3c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/meta", dir_fd:670, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f4753cb8478, flashback_version:0}, log_storage:{log_tail:{lsn:32418597}, readable_log_tail:{lsn:32418597}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/log", dir_fd:671, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:34686171, block_header_serialize_buf_:0x7f4753cba138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213336021452, this:0x7f4753cb69f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213336022204, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4753cb6430}) [2024-06-24 16:58:27.683506] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=367] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219507668077, last_flushed_end_lsn:{lsn:32418597}}]) [2024-06-24 16:58:27.683535] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=25] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=59962, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219507668077, last_flushed_end_lsn:{lsn:32418597}}]) [2024-06-24 16:58:27.684876] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=33] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:27.689815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:27.693293] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:27.694934] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=28] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:27.695027] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=25] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506800618000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:27.699269] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:27.701831] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A15EA-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:27.702048] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A15EA-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:27.702483] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A15EA-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:27.702865] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A15EA-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:27.703110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A15EA-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:27.709107] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:27.710776] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=34] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:27.710871] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=25] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219507115876000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:27.716969] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:27.717214] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219507716682000, start_id=1719219507716682000, end_id=1719219507716682001) [2024-06-24 16:58:27.719406] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D436-0-0] [lt=13] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:27.720160] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [162333][Blacklist][T0][Y0-0000000000000000-0-0] [lt=35] blacklist_loop exec finished(cost_time=46, is_enabled=true, send_cnt=0) [2024-06-24 16:58:27.720715] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FC6-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219507719843000, start_id=1719219507719843000, end_id=1719219507719843001) [2024-06-24 16:58:27.720738] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95422-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219507719843000, start_id=1719219507719843001, end_id=1719219507719843002) [2024-06-24 16:58:27.720789] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256BE3-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219507719843000, start_id=1719219507719843002, end_id=1719219507719843003) [2024-06-24 16:58:27.721486] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:27.721523] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=28] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:27.721558] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=103023206, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:27.722114] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=1, elapse_time=53397, size_used=3424, mem_used=72791040) [2024-06-24 16:58:27.729252] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=20] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:27.735103] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=49] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:27.737780] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107363B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:27.740574] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A161F-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:27.743307] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E1383A-0-0] [lt=11] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336728668212890625e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.886806925648696165e+01) [2024-06-24 16:58:27.743470] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219507743015000, start_id=1719219507743015000, end_id=1719219507743015001) [2024-06-24 16:58:27.745600] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073646-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:27.747778] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [1569][T1003_DupTbLeas][T1003][Y0-0000000000000000-0-0] [lt=12][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:27.747833] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [1569][T1003_DupTbLeas][T1003][Y0-0000000000000000-0-0] [lt=17][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1003 and flag like "%DUPLICATE%", tenant_id=1003, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:27.748269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A162C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:27.748959] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.750953] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A162E-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:27.755939] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219507755652000, start_id=1719219507755652000, end_id=1719219507755652001) [2024-06-24 16:58:27.766664] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=31] new mysql sessid created(conn.sessid_=3221494457, support_ssl=false) [2024-06-24 16:58:27.766739] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=31] sm conn init succ(conn.sessid_=3221494457, sess.client_addr_="172.20.17.86:49488") [2024-06-24 16:58:27.766763] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f47833c2d70, session_id:3221494457, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:27.766824] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2d70, session_id:3221494457, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:27.766858] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=29] kill and revert session(conn.sessid_=3221494457, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:27.766874] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f47833c2d70, session_id:3221494457, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:27.766901] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=25] mark session id unused(conn.sessid_=3221494457) [2024-06-24 16:58:27.766914] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494457, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:27.768066] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1669) [2024-06-24 16:58:27.768109] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=8, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=406, avg_log_submit_to_slide_time=418) [2024-06-24 16:58:27.773634] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.773891] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A164F-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:27.776588] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073676-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:27.779179] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=24] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1004, min_version={val:1719219507324493002, v:0}, base_version={val:1719219507324493000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219507324493002, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219507779167, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:27.780924] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A165B-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:27.781024] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219507780930000, start_id=1719219507780930000, end_id=1719219507780930001) [2024-06-24 16:58:27.781110] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8279, avg_group_log_size=636) [2024-06-24 16:58:27.781137] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8279) [2024-06-24 16:58:27.781467] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8279) [2024-06-24 16:58:27.781522] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=383, avg_log_submit_to_slide_time=393) [2024-06-24 16:58:27.783802] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:27.783903] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:27.784076] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:27.784132] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:27.784273] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:27.784336] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:27.784423] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107367F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:27.786488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283293347840, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:27.796439] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1682-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:27.802047] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=26] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16465, offset=3750267}, end_cursor:ObLogCursor{file_id=1, log_id=16466, offset=3750540}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fd4050, len:1669, log_data_len:273, seq:16465, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:27.803304] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219507802998000, start_id=1719219507802998000, end_id=1719219507802998001) [2024-06-24 16:58:27.803933] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F3-0-0] [lt=38][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:27.803959] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F3-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:27.806086] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F3-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219507805107000, start_id=1719219507805107000, end_id=1719219507805107001) [2024-06-24 16:58:27.807122] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16466, offset=3750540}, end_cursor:ObLogCursor{file_id=1, log_id=16467, offset=3750805}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fcc050, len:1396, log_data_len:265, seq:16466, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:27.813690] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107369F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:27.813906] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107369F-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:27.817592] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19E5E3-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:27.824122] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=10] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=26, mem_used=49913856) [2024-06-24 16:58:27.824145] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=16] release old cannot free more memory [2024-06-24 16:58:27.824152] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=6] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=30, size_used=0, mem_used=49913856) [2024-06-24 16:58:27.825441] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219507825095000, start_id=1719219507825095000, end_id=1719219507825095001) [2024-06-24 16:58:27.825573] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] gts statistics(tenant_id=1003, gts_rpc_cnt=10, get_gts_cache_cnt=394, get_gts_with_stc_cnt=66, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:27.837076] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16A2-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:27.837896] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=14] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:27.837946] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:27.837970] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1248) [2024-06-24 16:58:27.839687] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16A3-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:27.849018] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:27.849055] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=35] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:27.849075] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.855355] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=9] current monitor number(seq_=-1) [2024-06-24 16:58:27.859996] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:27.860074] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1719219507860071, bytes: 170525664, bw: 0.019019 MB/s, add_ts: 1007616, add_bytes: 20095 [2024-06-24 16:58:27.860205] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:27.860288] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:27.860372] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:27.860533] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:27.860758] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:27.860849] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:27.860924] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:27.861118] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:27.861196] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:27.861314] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:27.861383] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:27.861544] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:27.861614] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:27.861691] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:27.861791] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:27.861937] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:27.862006] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:27.862070] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:27.862138] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:27.862244] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:27.862312] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:27.862442] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:27.862511] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16AC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:27.873608] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873616] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873658] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873661] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873664] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873693] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.873851] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.873867] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874003] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874053] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874141] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874362] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874369] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874519] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874574] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874664] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.874704] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.875067] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:27.885896] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A16B5-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:27.889908] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:27.905746] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=13] ====== traversal_flush timer task ====== [2024-06-24 16:58:27.906018] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5C7-0-0] [lt=21] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219518711542000, latest_log_ts:{val:1719219502113333001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:27.906157] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5C7-0-0] [lt=131] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:27.910813] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:27.917292] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219507916900000, start_id=1719219507916900000, end_id=1719219507916900001) [2024-06-24 16:58:27.943573] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=17] submit log success(service_type_=0, last_id=1719219524521932000, limited_id=1719219524521932000) [2024-06-24 16:58:27.943594] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] submit log with lock success(service_type_=0, last_id=1719219524521932000, limited_id=1719219524521932000) [2024-06-24 16:58:27.943605] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=10] get number(ret=0, service_type_=0, range=1, base_id=1719219507943313000, start_id=1719219507943313000, end_id=1719219507943313001) [2024-06-24 16:58:27.944032] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=22] update id meta(ret=0, service_type=0, limited_id=1719219524521932000, latest_scn={val:1719219507943313001, v:0}, *this={tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:27.944111] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=77] handle submit callback(service_type_=0, success=true, used_ts=538, log_ts={val:1719219507943313001, v:0}, limited_id=1719219524521932000) [2024-06-24 16:58:27.944132] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=20] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:27.944149] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:27.944362] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219507943313000, start_id=1719219507943313001, end_id=1719219507943313002) [2024-06-24 16:58:27.944386] INFO [STORAGE.TRANS] wait_gts_elapse (ob_gts_source.cpp:434) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=20] wait queue push task success(task=0x7f474a90f4f0) [2024-06-24 16:58:27.944424] INFO [STORAGE.TRANS] wait_gts_elapse_commit_version_ (ob_trans_part_ctx.cpp:2846) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=13] need wait gts elapse(ret=0, ret="OB_SUCCESS", *this={this:0x7f474a90e050, ref:3, trans_id:{txid:82572}, tenant_id:1003, is_exiting:false, trans_expired_time:1719219537943303, cluster_version:17180066048, trans_need_wait_wrap:{receive_gts_ts_:[mts=0], need_wait_interval_us:0}, stc:[mts=1719219507943537], ctx_create_time:1719219507943313}{ls_id:{id:1}, session_id:1, part_trans_action:3, pending_write:0, exec_info:state:20, upstream:{id:-1}, participants:[{id:1}], incremental_participants:[], intermediate_participants:[], prev_record_lsn:{lsn:18446744073709551615}, redo_lsns:[], redo_log_no:0, multi_data_source:[], scheduler:"172.20.17.86:2882", prepare_version:{val:18446744073709551615, v:3}, trans_type:0, next_log_entry_no:1, max_applied_log_ts:{val:1719219507943313002, v:0}, max_applying_log_ts:{val:1719219507943313002, v:0}, max_applying_part_log_no:0, max_submitted_seq_no:{branch:0, seq:3}, checksum:[0], checksum_scn:[{val:0, v:0}], max_durable_lsn:{lsn:73460015}, data_complete:false, is_dup_tx:false, prepare_log_info_arr:[], xid:{gtrid_str:"", bqual_str:"", format_id:1, gtrid_str_.ptr():"data_size:0, data:", bqual_str_.ptr():"data_size:0, data:", g_hv:0, b_hv:0}, need_checksum:true, is_sub2pc:false, is_transfer_blocking:false, commit_parts:[{ls_id:{id:1}, exec_epoch:533300148149028, transfer_epoch:-1}], transfer_parts:[], is_empty_ctx_created_by_transfer:false, exec_epoch:0, serial_final_scn:{val:18446744073709551615, v:3}, serial_final_seq_no:0, dli_batch_set:, sub_state:{flag:22}, is_leaf():false, is_root():false, busy_cbs_.get_size():1, final_log_cb_:{ObTxBaseLogCb:{base_ts:{val:1719219507943313000, v:0}, log_ts:{val:1719219507943313002, v:0}, lsn:{lsn:73460015}, submit_ts:1719219507943648}, this:0x7f474a911978, is_inited_:true, trans_id:{txid:82572}, ls_id:{id:1}, ctx:0x7f474a90e050, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, ctx_tx_data_:{ctx_mgr_:0x7f46f0604030, tx_data_guard_:{tx_data:{tx_id:{txid:82572}, ref_cnt:1, state:"ELR_COMMIT", commit_version:{val:1719219507943313002, v:0}, start_scn:{val:1719219507943313002, v:0}, end_scn:{val:1719219507943313002, v:0}, undo_status_list:{head:null, undo_node_cnt:0{}}}}, read_only_:false}, role_state_:0, create_ctx_scn_:{val:18446744073709551615, v:3}, ctx_source:1, epoch_:533300148149028, replay_completeness_:1, mt_ctx_:{ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213356470096 max_table_version=1719213356470096 trans_version={val:1719219507943313000, v:0} commit_version={val:1719219507943313002, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:82572} ls_id=1 row_callback[alloc:1, free:0, unsubmit:0] redo[fill:2,sync_succ:2, sync_fail:0] main_list_len=2 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,2,2,2,2,0,0,0)|]}}, coord_prepare_info_arr_:[], upstream_state:10, retain_cause:-1, 2pc_role:-1, collected:[], rec_log_ts:{val:1719219507943313002, v:0}, prev_rec_log_ts:{val:18446744073709551615, v:3}, lastest_snapshot:{val:18446744073709551615, v:3}, state_info_array:[], last_request_ts:1719219507943313, block_frozen_memtable:null, max_2pc_commit_scn:{val:18446744073709551615, v:3}}) [2024-06-24 16:58:27.949076] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.956031] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219507955987000, start_id=1719219507955987000, end_id=1719219507955987001) [2024-06-24 16:58:27.958858] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:27.958894] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1226, avg_group_log_size=122) [2024-06-24 16:58:27.958918] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1226) [2024-06-24 16:58:27.958938] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:27.958973] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:27.958990] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:27.959270] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=412, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:27.973751] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:27.981309] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219507980278000, start_id=1719219507980278000, end_id=1719219507980278001) [2024-06-24 16:58:27.983296] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=49] LogLoopThread round_cost_time(us)(round_cost_time=18) [2024-06-24 16:58:27.987006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283289153536, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:27.988859] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1971][T1004_TTLTablet][T1004][YB42AC141156-00061B9D9A50C349-0-0] [lt=59] finish reload tenant task(local_tenant_task_={tenant_id:1004, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:28.002138] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:28.003396] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219508002457000, start_id=1719219508002457000, end_id=1719219508002457001) [2024-06-24 16:58:28.003475] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:28.003512] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:28.017561] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 375.50) [2024-06-24 16:58:28.017596] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:28.017709] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 360.50) [2024-06-24 16:58:28.017726] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:28.017758] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017778] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017793] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017807] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017824] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017838] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017852] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017865] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017879] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017897] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017928] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017942] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017959] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017972] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.017986] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:28.040105] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1719219498038075, end_time=1719219508040102, dag_status={}) [2024-06-24 16:58:28.040135] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040154] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040167] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040179] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040190] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040202] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040213] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040224] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040236] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:28.040248] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040264] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040277] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040290] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040303] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040316] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040332] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040345] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040355] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040394] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040407] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040434] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040483] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040496] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040509] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040521] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040537] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040549] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040562] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040600] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040612] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040649] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040665] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040678] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040717] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040755] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040784] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040797] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040810] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040848] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040874] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040901] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040911] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040924] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040936] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040949] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040975] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.040989] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.041002] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.041015] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:28.041028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:28.041037] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:28.041048] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:28.041056] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:28.041065] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:28.041072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:28.041081] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:28.041087] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:28.041098] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:28.041104] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:28.041114] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:28.041128] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3730) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2024-06-24 16:58:28.041141] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3753) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2024-06-24 16:58:28.042629] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A174B-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.045330] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A174D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.049136] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.050775] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19E762-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.053051] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:28.053511] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1757-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.056544] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107371A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.059353] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:28.059383] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:28.059413] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=465, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:28.059433] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:28.067839] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:28.067882] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:28.067913] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:28.067937] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:28.068276] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=395, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:28.068310] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:28.068340] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:28.068370] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=471, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:28.068389] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=28, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:28.068522] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=380, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:28.068550] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=21, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:28.068567] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:28.068585] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=495, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:28.068600] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=24, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:28.073809] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.081198] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C39-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.082966] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD724-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.086046] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=32] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:28.086987] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A177D-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.089672] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:28.089764] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:28.089526] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=48] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:74397, max_lsn:57962922, max_scn:{val:1719219507825095002, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:57962922}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16019882}}, last_submit_lsn:{lsn:57962800}, last_submit_end_lsn:{lsn:57962922}, last_submit_log_id:74397, last_submit_log_pid:1, max_flushed_lsn:{lsn:57962800}, max_flushed_end_lsn:{lsn:57962922}, max_flushed_log_pid:1, committed_end_lsn:{lsn:57962922}, last_slide_log_id:74397, last_slide_scn:{val:1719219507825095002, v:0}, last_slide_lsn:{lsn:57962800}, last_slide_end_lsn:{lsn:57962922}, last_slide_log_pid:1, last_slide_log_accum_checksum:3798881004, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d2f88530}, [StateMgr]={this:0x7f46d2f8c2b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:74398, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213376431572, palf_role_change_cb:0x7f46d2f92cb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d2f89c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213369678630002, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1719213369678630001, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/meta", dir_fd:689, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d2f8e478, flashback_version:0}, log_storage:{log_tail:{lsn:57962922}, readable_log_tail:{lsn:57962922}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1719213369678630002, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/log", dir_fd:690, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:9141846, block_header_serialize_buf_:0x7f46d2f90138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213376431519, this:0x7f46d2f8c9f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213376432460, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d2f8c430}) [2024-06-24 16:58:28.089900] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=370] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219508059364, last_flushed_end_lsn:{lsn:57962922}}]) [2024-06-24 16:58:28.089939] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:28.089929] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=25] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=74398, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219508059364, last_flushed_end_lsn:{lsn:57962922}}]) [2024-06-24 16:58:28.089996] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:28.090001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:28.090138] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:28.090203] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:28.090290] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1780-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:28.093898] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=249, mem_used=2079744) [2024-06-24 16:58:28.096118] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096827] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.096993] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097051] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097102] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097100] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097281] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097325] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097327] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=7] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097613] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097669] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=6] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097663] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097684] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097681] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097690] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097689] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097691] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097707] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097726] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097736] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097743] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097737] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097854] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097956] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.097974] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098172] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098183] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098321] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098322] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098681] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098680] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098687] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098689] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098689] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098692] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098687] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098694] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098701] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098754] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098813] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.098814] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.101944] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A178F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.110781] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:28.110805] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:28.110835] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=73461137, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:28.111463] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD19-0-0] [lt=25] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:28.111505] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD19-0-0] [lt=30] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=50) [2024-06-24 16:58:28.117471] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219508116582000, start_id=1719219508116582000, end_id=1719219508116582001) [2024-06-24 16:58:28.117979] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3535) [2024-06-24 16:58:28.118018] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=414, avg_log_submit_to_slide_time=427) [2024-06-24 16:58:28.130692] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EB-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:28.130734] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EB-0-0] [lt=39] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:28.131878] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D0-0-0] [lt=14] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:28.131908] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D0-0-0] [lt=26] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:28.132653] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=12] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:28.138518] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A17B1-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.141126] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A17B3-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.143662] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219508143005000, start_id=1719219508143005000, end_id=1719219508143005001) [2024-06-24 16:58:28.149194] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.156199] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219508155691000, start_id=1719219508155691000, end_id=1719219508155691001) [2024-06-24 16:58:28.166579] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D89C-0-0] [lt=67][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:28.167906] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:28.167943] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1791) [2024-06-24 16:58:28.167979] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=7235, avg_group_log_size=452) [2024-06-24 16:58:28.167998] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7235) [2024-06-24 16:58:28.173913] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:28.173940] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:28.173958] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.174245] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=20] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:28.181381] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219508181049000, start_id=1719219508181049000, end_id=1719219508181049001) [2024-06-24 16:58:28.187485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283293347840, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:28.189663] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073775-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.200869] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:28.203512] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219508203379000, start_id=1719219508203379000, end_id=1719219508203379001) [2024-06-24 16:58:28.229779] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=54] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=211402, mem_used=436746240) [2024-06-24 16:58:28.233494] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:28.233543] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2024-06-24 16:58:28.233572] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3535) [2024-06-24 16:58:28.233593] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:28.233952] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3535) [2024-06-24 16:58:28.234050] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:28.234076] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=451, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:28.234090] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:28.248131] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=7] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:28.248149] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=16] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:28.248158] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=8] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:28.248167] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=8] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:28.249254] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.252159] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=5] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:92233720368547 [2024-06-24 16:58:28.252992] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=831] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:28.259534] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=15, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:28.259565] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=421, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:28.259583] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:28.259598] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=-625, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:28.259612] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=-187, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:28.267927] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:28.267951] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] try gc retain ctx [2024-06-24 16:58:28.267976] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=8] get_max_applied_scn(scn={val:1719219507825095003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32419207}, palf_committed_end_scn_:{val:1719219507825095003, v:0}, last_check_scn_:{val:1719219507825095003, v:0}, max_applied_cb_scn_:{val:1719219507825095003, v:0}}) [2024-06-24 16:58:28.268012] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:28.270546] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=98] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219505338748002, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219516480480000, latest_log_ts:{val:1719219500231259001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:28.273030] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=114] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219505338748002, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:28.273927] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.275398] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:28.275431] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=32] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:28.275433] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C723-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:28.275469] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C723-0-0] [lt=28] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:28.287084] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:28.287302] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=43] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:28.287330] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:28.287404] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=145041, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373857526, tmp_max_wa_memory_size=373857527, pre_mem_target=373712486, remain_memory_size=373712486, ratio=6.916093826293945312e-02, alloc_ratio=3.879579506232597695e-04, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1577213952, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5938978816, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:28.287520] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46732190, calc_global_bound_size=1048576000000, mem_target_=373857526, wa_max_memory_size=373857526, profile_cnt_=2, total_memory_size=6120112, max_wa_size=373857526, avg_bound_size=186928763, max_bound_size=46732190, min_bound_size_=1048576) [2024-06-24 16:58:28.287544] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=46732190, manual_calc_cnt_=415927, drift_size_=0, pre_drift_size=-8217264, wa_max_memory_size=373857526, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=1, pre_profile_cnt=2, calc_info.get_global_bound_size()=46732190, total_memory_size=6120112, cur_profile_cnt=1, calc_info.get_mem_target()=373857526, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:28.287604] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=19] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:28.287711] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=51] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:28.287731] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:28.287793] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:28.287993] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:28.288015] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:28.290098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:28.317468] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219508317463000, start_id=1719219508317463000, end_id=1719219508317463001) [2024-06-24 16:58:28.326327] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219508325921000, start_id=1719219508325921000, end_id=1719219508325921001) [2024-06-24 16:58:28.326378] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=399, get_gts_with_stc_cnt=31, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:28.326402] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:28.336818] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1864-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.339839] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19E916-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.341438] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=33] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:28.343772] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219508342812000, start_id=1719219508342812000, end_id=1719219508342812001) [2024-06-24 16:58:28.344349] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1003, new_min_version={val:1719219508143005000, v:0}, new_max_version={val:1719219508143005000, v:0}, last_min_version={val:1719219507943313002, v:0}, last_max_version={val:1719219507943313002, v:0}, total_time_us=1984, delta_us=201343) [2024-06-24 16:58:28.344374] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219508143005000, v:0}, min_version={val:1719219508143005000, v:0}, max_version={val:1719219508143005000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:28.344489] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A186C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.347419] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107380E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.349312] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.350054] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1871-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.356604] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219508356468000, start_id=1719219508356468000, end_id=1719219508356468001) [2024-06-24 16:58:28.357137] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=371, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:28.357184] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=16, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:28.357218] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:28.357254] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=438, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:28.357285] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=27, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:28.359146] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:28.359177] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:28.368473] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4094) [2024-06-24 16:58:28.368516] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=4094) [2024-06-24 16:58:28.368553] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=43, avg_log_gen_to_submit_time=50, avg_log_submit_to_flush_time=431, avg_log_submit_to_slide_time=443) [2024-06-24 16:58:28.372222] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1886-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.373985] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.375190] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073829-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.377043] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95545-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219508376546000, start_id=1719219508376546000, end_id=1719219508376546001) [2024-06-24 16:58:28.379510] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107382C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.381494] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219508380776000, start_id=1719219508380776000, end_id=1719219508380776001) [2024-06-24 16:58:28.382311] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:28.382428] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:28.382646] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:28.382716] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:28.382885] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:28.382969] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:28.383074] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9554D-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:28.383820] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=15) [2024-06-24 16:58:28.387976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283289153536, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:28.389983] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A18AC-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219508389231000, start_id=1719219508389231000, end_id=1719219508389231001) [2024-06-24 16:58:28.393269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A18AF-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.403612] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219508402972000, start_id=1719219508402972000, end_id=1719219508402972001) [2024-06-24 16:58:28.403708] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7773, avg_group_log_size=647) [2024-06-24 16:58:28.403735] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7773) [2024-06-24 16:58:28.418975] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129579, mem_used=326519808) [2024-06-24 16:58:28.425918] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A18C2-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.428420] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A18C3-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.430653] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=9] ====== checkpoint timer task ====== [2024-06-24 16:58:28.431675] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=66] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:28.432838] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=33] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:28.432886] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=46] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:28.432932] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=38] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:28.433089] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219505456994003, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:28.433203] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=109] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:28.433254] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=42] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:28.433277] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219507324493001, v:0}) [2024-06-24 16:58:28.433291] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:28.433321] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=14] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:28.433351] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:28.433374] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:28.434037] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=376, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:28.434072] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:28.435495] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=14] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:28.435525] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=29] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:28.435557] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:28.435793] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=21] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219505456994003, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:28.435904] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=104] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:28.435924] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:28.435949] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:28.435970] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:28.435990] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:28.436007] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:28.440577] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=8] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:28.440606] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=24] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:28.440619] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=11] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:28.440644] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=24] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:28.447128] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=41] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:28.447548] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=415] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:28.449370] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.455287] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2024-06-24 16:58:28.460025] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:28.460077] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=429, avg_log_submit_to_slide_time=440) [2024-06-24 16:58:28.463019] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=107] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:28.463045] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=24] try gc retain ctx [2024-06-24 16:58:28.463068] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=9] get_max_applied_scn(scn={val:1719219508402972000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70215045}, palf_committed_end_scn_:{val:1719219508402972000, v:0}, last_check_scn_:{val:1719219508402972000, v:0}, max_applied_cb_scn_:{val:1719219508402972000, v:0}}) [2024-06-24 16:58:28.463100] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=29] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:28.465553] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=96] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219517830421000, latest_log_ts:{val:1719219501198972001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:28.471446] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BCFEF-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.473334] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB3D-0-0] [lt=20][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103404564698, cache_obj->added_lc()=false, cache_obj->get_object_id()=9347, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:28.474045] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.479473] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:28.487187] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=52] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:28.497349] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1719219508497345, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-06-24 16:58:28.501629] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=81700000, replace_num=100000) [2024-06-24 16:58:28.501658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:28.515405] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13714, offset=3444060}, end_cursor:ObLogCursor{file_id=1, log_id=13715, offset=3444333}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fd8050, len:676, log_data_len:273, seq:13714, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:28.517647] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219508517026000, start_id=1719219508517026000, end_id=1719219508517026001) [2024-06-24 16:58:28.518949] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D903-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219508518082000, start_id=1719219508518082000, end_id=1719219508518082001) [2024-06-24 16:58:28.519401] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7885) [2024-06-24 16:58:28.519448] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7885) [2024-06-24 16:58:28.519485] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=412, avg_log_submit_to_slide_time=423) [2024-06-24 16:58:28.520108] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13715, offset=3444333}, end_cursor:ObLogCursor{file_id=1, log_id=13716, offset=3444598}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fdc050, len:403, log_data_len:265, seq:13715, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:28.544426] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219508543385000, start_id=1719219508543385000, end_id=1719219508543385001) [2024-06-24 16:58:28.544502] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:28.544533] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:28.544933] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=357, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:28.544964] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:28.544992] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:28.545018] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=441, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:28.545036] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=25, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:28.549429] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.556356] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1719219508556014000, start_id=1719219508556014000, end_id=1719219508556014001) [2024-06-24 16:58:28.556889] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=33, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:28.556917] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=27] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=424, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:28.556934] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:28.556947] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-461, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:28.556959] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-2, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:28.574104] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.581603] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219508581304000, start_id=1719219508581304000, end_id=1719219508581304001) [2024-06-24 16:58:28.582079] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7892) [2024-06-24 16:58:28.580821] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1973] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:66, min_worker_cnt:42, max_worker_cnt:150, stopped:0, worker_us:366833948, recv_hp_rpc_cnt:3228, recv_np_rpc_cnt:3442, recv_lp_rpc_cnt:0, recv_mysql_cnt:32188, recv_task_cnt:51, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:24897347, workers:42, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=128 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:25006, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213256365800}{group_id:10, queue_size:0, recv_req_cnt:6245, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213261360250}{group_id:20, queue_size:0, recv_req_cnt:965, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918743789}{group_id:15, queue_size:0, recv_req_cnt:13, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216919852802}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213258715738}{group_id:9, queue_size:0, recv_req_cnt:160, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213252335182}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=2, token_change_ts:1719213259025542, tenant_role:1}) [2024-06-24 16:58:28.583065] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=2241] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245340110, is_removed:false}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:79501807, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:1381, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:31095133, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info: pcode=0x5c0:cnt=4, token_change_ts:1719213259035589, tenant_role:0}) [2024-06-24 16:58:28.584940] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1874] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245333314, is_removed:false}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:43758239, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:15546414, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1719213259048104, tenant_role:0}) [2024-06-24 16:58:28.588426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283289153536, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:28.586810] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1869] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:23497593, recv_hp_rpc_cnt:74, recv_np_rpc_cnt:6084, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2467973, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24730, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213325131824}{group_id:20, queue_size:0, recv_req_cnt:641, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215168816313}{group_id:5, queue_size:0, recv_req_cnt:22, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213327935283}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1719213324836532, tenant_role:1}) [2024-06-24 16:58:28.590355] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3730) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2024-06-24 16:58:28.590394] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3753) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=38] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2024-06-24 16:58:28.588769] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1958] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:150, stopped:0, worker_us:6410624551, recv_hp_rpc_cnt:2104, recv_np_rpc_cnt:7, recv_lp_rpc_cnt:0, recv_mysql_cnt:17532535, recv_task_cnt:354, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:43443564, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49336, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213333985763}{group_id:20, queue_size:0, recv_req_cnt:1946, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215769388477}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918841349}, rpc_stat_info: pcode=0x150a:cnt=40 pcode=0x150b:cnt=40, token_change_ts:1719213324547495, tenant_role:1}) [2024-06-24 16:58:28.590703] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1933] dump tenant info(tenant={id:1003, tenant_meta:{unit:{tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1003, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:26093540, recv_hp_rpc_cnt:57, recv_np_rpc_cnt:6060, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2457887, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24624, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213351914771}{group_id:20, queue_size:0, recv_req_cnt:564, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216369834163}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213354638840}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1719213351641415, tenant_role:1}) [2024-06-24 16:58:28.592675] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1970] dump tenant info(tenant={id:1004, tenant_meta:{unit:{tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1004, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:184, stopped:0, worker_us:183897380, recv_hp_rpc_cnt:5103, recv_np_rpc_cnt:1393, recv_lp_rpc_cnt:0, recv_mysql_cnt:40505, recv_task_cnt:15, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:9865299, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49120, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213361134602}{group_id:20, queue_size:0, recv_req_cnt:3494, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216969504568}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918851855}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x51f:cnt=4, token_change_ts:1719217153282307, tenant_role:1}) [2024-06-24 16:58:28.599312] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:227) [162289][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=26] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=0) [2024-06-24 16:58:28.603750] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219508603447000, start_id=1719219508603447000, end_id=1719219508603447001) [2024-06-24 16:58:28.605641] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1921-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.608034] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1922-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.612533] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1924-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.614911] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1925-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.617480] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1926-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.619295] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:28.620342] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:28.638208] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1931-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.639891] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD4D-0-0] [lt=26] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:28.640699] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1932-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.644404] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1934-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.646742] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:28.646837] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:28.646993] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:28.647046] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:28.647174] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:28.647234] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:28.647314] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1936-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:28.649488] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.659584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1937-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.659727] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=427, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:28.659736] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:28.659756] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:28.659779] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:28.659791] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:28.659816] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:28.659835] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=501, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:28.659851] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=481, avg_log_submit_to_slide_time=488) [2024-06-24 16:58:28.659871] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:28.668590] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1089) [2024-06-24 16:58:28.674164] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.692869] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1945-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.695361] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1946-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4804, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.699129] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:28.699350] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:28.701745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:28.717683] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219508717352000, start_id=1719219508717352000, end_id=1719219508717352001) [2024-06-24 16:58:28.722251] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=7182, mem_used=79030272) [2024-06-24 16:58:28.729357] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=21] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:28.742431] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A195E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.744427] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E1383F-0-0] [lt=14] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336743803024291992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.886405955689659208e+01) [2024-06-24 16:58:28.744682] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1719219508743745000, start_id=1719219508743745000, end_id=1719219508743745001) [2024-06-24 16:58:28.749549] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.756492] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219508756426000, start_id=1719219508756426000, end_id=1719219508756426001) [2024-06-24 16:58:28.766858] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221494458, support_ssl=false) [2024-06-24 16:58:28.766946] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=36] sm conn init succ(conn.sessid_=3221494458, sess.client_addr_="172.20.17.86:49490") [2024-06-24 16:58:28.766970] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f47833c2030, session_id:3221494458, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:28.767119] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=35][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494458, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:28.767154] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=31] kill and revert session(conn.sessid_=3221494458, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:28.767172] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494458, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:28.767195] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=21] mark session id unused(conn.sessid_=3221494458) [2024-06-24 16:58:28.767208] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494458, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:28.768780] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1089) [2024-06-24 16:58:28.768823] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=11, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=458, avg_log_submit_to_slide_time=472) [2024-06-24 16:58:28.774223] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.780656] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219508779711000, start_id=1719219508779711000, end_id=1719219508779711001) [2024-06-24 16:58:28.784095] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:91032, max_lsn:70218801, max_scn:{val:1719219508756426000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:70218801}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:28275761}}, last_submit_lsn:{lsn:70218211}, last_submit_end_lsn:{lsn:70218801}, last_submit_log_id:91032, last_submit_log_pid:1, max_flushed_lsn:{lsn:70218211}, max_flushed_end_lsn:{lsn:70218801}, max_flushed_log_pid:1, committed_end_lsn:{lsn:70218801}, last_slide_log_id:91032, last_slide_scn:{val:1719219508756426000, v:0}, last_slide_lsn:{lsn:70218211}, last_slide_end_lsn:{lsn:70218801}, last_slide_log_pid:1, last_slide_log_accum_checksum:798766978, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4755346530}, [StateMgr]={this:0x7f475534a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:91033, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213327209529, palf_role_change_cb:0x7f4755350cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4755347c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/meta", dir_fd:666, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f475534c478, flashback_version:0}, log_storage:{log_tail:{lsn:70218801}, readable_log_tail:{lsn:70218801}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719219133216967001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/log", dir_fd:667, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:63990735, block_header_serialize_buf_:0x7f475534e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213327209030, this:0x7f475534a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213327209993, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f475534a430}) [2024-06-24 16:58:28.784451] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=351] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219508757029, last_flushed_end_lsn:{lsn:70218801}}]) [2024-06-24 16:58:28.784479] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=91033, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219508757029, last_flushed_end_lsn:{lsn:70218801}}]) [2024-06-24 16:58:28.788901] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283284959232, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:28.803928] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219508802970000, start_id=1719219508802970000, end_id=1719219508802970001) [2024-06-24 16:58:28.804534] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:28.810502] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=16307406, clean_num=201326) [2024-06-24 16:58:28.810986] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=8] ====== check clog disk timer task ====== [2024-06-24 16:58:28.811008] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=114) [2024-06-24 16:58:28.811026] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=9] cannot_recycle_log_size statistics(cannot_recycle_log_size=53431129, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:28.811167] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=27] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16467, offset=3750805}, end_cursor:ObLogCursor{file_id=1, log_id=16468, offset=3751078}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fe0050, len:1131, log_data_len:273, seq:16467, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:28.813058] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F4-0-0] [lt=31][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:28.813084] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F4-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:28.815199] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F4-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219508814566000, start_id=1719219508814566000, end_id=1719219508814566001) [2024-06-24 16:58:28.815288] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F4-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=9017, avg_group_log_size=644) [2024-06-24 16:58:28.815320] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F4-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8481) [2024-06-24 16:58:28.815696] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9017) [2024-06-24 16:58:28.815756] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=28, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=402, avg_log_submit_to_slide_time=412) [2024-06-24 16:58:28.816352] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16468, offset=3751078}, end_cursor:ObLogCursor{file_id=1, log_id=16469, offset=3751343}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fe4050, len:858, log_data_len:265, seq:16468, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:28.824237] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=9] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=31, mem_used=49913856) [2024-06-24 16:58:28.824257] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=12] release old cannot free more memory [2024-06-24 16:58:28.824265] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=29, size_used=0, mem_used=49913856) [2024-06-24 16:58:28.827684] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219508827267000, start_id=1719219508827267000, end_id=1719219508827267001) [2024-06-24 16:58:28.849609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.855482] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=29] current monitor number(seq_=-1) [2024-06-24 16:58:28.867689] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1719219508867688, bytes: 170546719, bw: 0.019928 MB/s, add_ts: 1007617, add_bytes: 21055 [2024-06-24 16:58:28.873465] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.873532] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.873662] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.873696] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.873818] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.873876] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.873880] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874044] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874249] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874263] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874281] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.874451] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874453] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874453] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874463] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874680] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874695] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874708] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874723] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874731] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874751] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874755] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874760] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874777] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874792] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.874795] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.875126] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:28.881236] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19A4-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.883804] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19A5-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.888278] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=40] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:28.888407] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19A7-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.890834] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19A8-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.893422] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19A9-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:28.901845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:28.910869] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=16] gc stale ls task succ [2024-06-24 16:58:28.915573] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19B5-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:28.917850] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219508916925000, start_id=1719219508916925000, end_id=1719219508916925001) [2024-06-24 16:58:28.918179] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19B7-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:28.922011] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19B9-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.924551] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:28.924652] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:28.924817] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:28.924871] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:28.925002] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:28.925063] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:28.925144] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BB-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:28.928404] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=24] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:28.936922] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19BC-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:28.944695] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219508944388000, start_id=1719219508944388000, end_id=1719219508944388001) [2024-06-24 16:58:28.949635] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=35][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.950132] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=28] ====== tenant freeze timer task ====== [2024-06-24 16:58:28.956618] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219508955969000, start_id=1719219508955969000, end_id=1719219508955969001) [2024-06-24 16:58:28.959519] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:28.959566] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:28.959604] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:28.959670] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:28.959727] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:28.959756] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:28.960173] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=416, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:28.968746] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A18AC-0-0] [lt=5] [APPLY STAT CB APPEND COST TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=29, this=0x7f4753d24280, extra_info="") [2024-06-24 16:58:28.968777] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A18AC-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=434, this=0x7f4753d244b0, extra_info="") [2024-06-24 16:58:28.968792] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A18AC-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=0, this=0x7f4753d246e0, extra_info="") [2024-06-24 16:58:28.968807] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A18AC-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=-520, this=0x7f4753d24910, extra_info="") [2024-06-24 16:58:28.968821] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A18AC-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=-57, this=0x7f4753d24b40, extra_info="") [2024-06-24 16:58:28.969532] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19CB-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:28.972043] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19CC-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4804, pos=2778, bitmap=NULL) [2024-06-24 16:58:28.974335] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:28.980769] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219508980265000, start_id=1719219508980265000, end_id=1719219508980265001) [2024-06-24 16:58:29.002198] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:29.003982] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219509003506000, start_id=1719219509003506000, end_id=1719219509003506001) [2024-06-24 16:58:29.004056] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:29.004093] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:29.005444] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=34] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261362225152) [2024-06-24 16:58:29.010968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283282862080, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:29.014508] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A19E0-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:29.019982] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 397.00) [2024-06-24 16:58:29.020013] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:29.020119] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 378.50) [2024-06-24 16:58:29.020136] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:29.020174] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020194] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020209] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020223] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020240] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020254] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020268] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020281] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020308] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020322] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020337] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020349] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020365] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020379] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.020393] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:29.034811] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:29.034846] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:29.034879] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348707107, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:29.049695] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.053179] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:29.059958] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:29.059990] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:29.060019] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=459, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:29.060039] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:29.068426] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:29.068461] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:29.068490] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:29.068512] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:29.068786] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=379, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:29.068809] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=12, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:29.068839] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:29.068868] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=454, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:29.068888] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=31, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:29.069044] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=372, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:29.069082] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:29.069097] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:29.069113] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=442, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:29.069127] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=25, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:29.074391] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.094030] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=279, mem_used=2079744) [2024-06-24 16:58:29.096647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.096662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.096660] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.096663] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.096763] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097007] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097090] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097127] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097181] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097555] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097674] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097668] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097682] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097670] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097686] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097703] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097708] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097725] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097701] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097743] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097718] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097752] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097773] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097772] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097767] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097809] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097921] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097944] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.097860] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098021] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098047] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098051] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098060] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098290] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098405] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098444] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098682] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098745] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098747] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098770] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=52] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098791] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098781] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098785] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098790] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098795] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098784] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098804] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098801] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098805] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098806] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098814] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098870] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.098888] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.099424] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.101954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:29.117978] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219509117241000, start_id=1719219509117241000, end_id=1719219509117241001) [2024-06-24 16:58:29.118527] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3533) [2024-06-24 16:58:29.118559] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=440, avg_log_submit_to_slide_time=451) [2024-06-24 16:58:29.132691] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EC-0-0] [lt=46] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:29.132726] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EC-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:29.132763] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=18] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:29.133455] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D1-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:29.133484] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D1-0-0] [lt=26] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:29.143781] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219509143633000, start_id=1719219509143633000, end_id=1719219509143633001) [2024-06-24 16:58:29.145270] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:29.145301] INFO [COMMON] handle (memory_dump.cpp:552) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:29.145546] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] update_check_range(min_check_version=620, max_check_version=622, global_version=623) [2024-06-24 16:58:29.149753] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.156676] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] get number(ret=0, service_type_=0, range=1, base_id=1719219509156321000, start_id=1719219509156321000, end_id=1719219509156321001) [2024-06-24 16:58:29.168488] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1089, avg_group_log_size=121) [2024-06-24 16:58:29.168519] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1089) [2024-06-24 16:58:29.168564] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2209, avg_group_log_size=200) [2024-06-24 16:58:29.168584] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2209) [2024-06-24 16:58:29.174366] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=29] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:29.174446] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.178020] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D89D-0-0] [lt=53][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:29.180564] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A22-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:29.180891] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219509180607000, start_id=1719219509180607000, end_id=1719219509180607001) [2024-06-24 16:58:29.182408] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=42] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:29.183713] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A23-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:29.189552] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A25-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:29.192688] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A26-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:29.195938] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A27-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:29.200928] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=15] gc stale ls task succ [2024-06-24 16:58:29.204146] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219509203831000, start_id=1719219509203831000, end_id=1719219509203831001) [2024-06-24 16:58:29.211498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283284959232, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:29.222788] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A30-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:29.225927] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [703][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CB94CD8-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:29.229906] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=211421, mem_used=436746240) [2024-06-24 16:58:29.230964] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A32-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:29.233959] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:29.234076] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:29.234075] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:29.234110] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3533, avg_group_log_size=353) [2024-06-24 16:58:29.234136] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3533) [2024-06-24 16:58:29.234157] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:29.234295] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:29.234362] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:29.234530] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:29.234515] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3533) [2024-06-24 16:58:29.234585] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:29.234608] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:29.234614] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=462, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:29.234656] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:29.234721] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A34-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:29.246554] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A35-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:29.249811] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.274500] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.288726] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A48-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:29.289536] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=55] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:29.290803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [1392][T1004_SSTableGC][T1004][YB42AC141156-00061B9D99A0C1B1-0-0] [lt=23] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217706784804000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217696777144000) [2024-06-24 16:58:29.292144] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1A49-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:29.300147] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:29.300179] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=130) [2024-06-24 16:58:29.300211] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=70221751, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:29.302053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:29.318183] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219509317566000, start_id=1719219509317566000, end_id=1719219509317566001) [2024-06-24 16:58:29.319914] INFO handle (memory_dump.cpp:679) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] statistics: tenant_cnt: 8, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 353 257 0 1 2 65 1 0 1 4 1 1 0 1 5 67 4 0 1 7 1 2 0 1 8 72 1 0 1 12 7 3 0 1 13 7 1 0 1 14 1 2 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 1 22 1 1 0 500 0 105 240 0 500 7 4 4 0 500 8 85 1 0 500 9 5 1 0 500 10 6 2 0 500 16 3 1 0 500 17 37 7 0 500 22 90 62 0 500 23 69 11 0 508 0 5 11 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 90 221 0 1001 2 22 1 0 1001 4 1 1 0 1001 5 19 4 0 1001 8 45 1 0 1001 12 4 3 0 1001 13 2 1 0 1001 14 1 2 0 1001 18 7 3 0 1001 20 1 1 0 1002 0 183 248 0 1002 2 201 1 0 1002 3 1 1 0 1002 4 1 1 0 1002 5 109 4 0 1002 6 1 2 0 1002 8 59 1 0 1002 12 14 3 0 1002 13 9 1 0 1002 14 1 2 0 1002 18 7 3 0 1002 20 1 1 0 1003 0 125 225 0 1003 2 22 1 0 1003 4 1 1 0 1003 5 30 4 0 1003 8 47 1 0 1003 12 5 3 0 1003 13 2 1 0 1003 14 1 2 0 1003 18 6 3 0 1003 20 1 1 0 1004 0 320 249 0 1004 2 95 1 0 1004 4 1 1 0 1004 5 71 4 0 1004 8 60 1 0 1004 12 17 3 0 1004 13 10 1 0 1004 14 1 2 0 1004 18 6 3 0 1004 20 1 1 0 cost_time: 174429 [2024-06-24 16:58:29.319960] INFO [LIB] operator() (ob_malloc_allocator.cpp:542) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 18,253,611,008 hold: 1,751,019,520 rpc_hold: 0 cache_hold: 232,783,872 cache_used: 232,783,872 cache_item_count: 111 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 1,008,607,232 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 136,314,880 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 140,509,184 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 150,994,944 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 14,680,064 limit= 3,650,722,200 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 6,311,936 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2024-06-24 16:58:29.320015] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=14] ====== tenant freeze timer task ====== [2024-06-24 16:58:29.320368] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 1,008,607,232 used= 901,999,296 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 516,997,120 used= 516,757,184 count= 212 avg_used= 2,437,533 block_cnt= 212 chunk_cnt= 212 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 38,563,840 used= 38,535,392 count= 2 avg_used= 19,267,696 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 37,769,216 used= 37,748,856 count= 1 avg_used= 37,748,856 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 24,727,552 used= 24,661,440 count= 39 avg_used= 632,344 block_cnt= 39 chunk_cnt= 22 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 18,800,640 used= 17,629,680 count= 255 avg_used= 69,136 block_cnt= 255 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 16,797,696 used= 16,777,336 count= 1 avg_used= 16,777,336 block_cnt= 1 chunk_cnt= 1 mod=MrgMemPoolChk [MEMORY] hold= 15,014,736 used= 14,885,937 count= 98 avg_used= 151,897 block_cnt= 37 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 12,492,800 used= 12,451,840 count= 2 avg_used= 6,225,920 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 8,257,536 used= 8,240,064 count= 2 avg_used= 4,120,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 6,862,480 used= 6,837,464 count= 70 avg_used= 97,678 block_cnt= 70 chunk_cnt= 12 mod=TabletMap [MEMORY] hold= 6,381,568 used= 5,627,904 count= 92 avg_used= 61,172 block_cnt= 92 chunk_cnt= 23 mod=[T]char [MEMORY] hold= 6,148,096 used= 6,131,072 count= 1 avg_used= 6,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,601,152 used= 4,530,096 count= 978 avg_used= 4,632 block_cnt= 978 chunk_cnt= 33 mod=WorkerMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 6 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,883,008 used= 3,841,152 count= 6 avg_used= 640,192 block_cnt= 6 chunk_cnt= 2 mod=TransTimeWheel [MEMORY] hold= 3,883,008 used= 3,841,152 count= 6 avg_used= 640,192 block_cnt= 6 chunk_cnt= 3 mod=XATimeWheel [MEMORY] hold= 3,842,048 used= 3,820,032 count= 2 avg_used= 1,910,016 block_cnt= 2 chunk_cnt= 2 mod=LDBlockBitMap [MEMORY] hold= 3,763,584 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 13 mod=CkptDgnMemCU [MEMORY] hold= 3,763,584 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 14 mod=CkptDgnMem [MEMORY] hold= 3,723,264 used= 3,698,688 count= 2 avg_used= 1,849,344 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 6 mod=SqlDtlQueue [MEMORY] hold= 2,711,552 used= 2,693,824 count= 1 avg_used= 2,693,824 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,864 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,097,152 used= 2,093,056 count= 32 avg_used= 65,408 block_cnt= 32 chunk_cnt= 12 mod=StorMetaCacheIO [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 2 mod=DagMap [MEMORY] hold= 1,777,664 used= 1,770,696 count= 1 avg_used= 1,770,696 block_cnt= 1 chunk_cnt= 1 mod=TableProc [MEMORY] hold= 1,681,536 used= 1,666,560 count= 205 avg_used= 8,129 block_cnt= 205 chunk_cnt= 23 mod=ParamCharsType [MEMORY] hold= 1,584,288 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,269,184 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 2 mod=PoolFreeList [MEMORY] hold= 1,253,376 used= 1,114,112 count= 17 avg_used= 65,536 block_cnt= 17 chunk_cnt= 8 mod=MinorMergeMgr [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 950,272 used= 508,544 count= 58 avg_used= 8,768 block_cnt= 58 chunk_cnt= 20 mod=[T]ObDSActionAr [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 920,000 used= 912,640 count= 115 avg_used= 7,936 block_cnt= 115 chunk_cnt= 22 mod=QueryAllocator [MEMORY] hold= 829,632 used= 804,864 count= 258 avg_used= 3,119 block_cnt= 130 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 819,200 used= 804,640 count= 5 avg_used= 160,928 block_cnt= 5 chunk_cnt= 5 mod=SQLSessionInfo [MEMORY] hold= 802,944 used= 786,432 count= 256 avg_used= 3,072 block_cnt= 128 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 794,624 used= 786,440 count= 1 avg_used= 786,440 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 794,624 used= 786,440 count= 1 avg_used= 786,440 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 786,560 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 2 mod=LogAlloc [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 576,128 used= 571,392 count= 72 avg_used= 7,936 block_cnt= 72 chunk_cnt= 22 mod=GlobalIter [MEMORY] hold= 566,784 used= 558,912 count= 123 avg_used= 4,544 block_cnt= 123 chunk_cnt= 22 mod=[T]ObTraceEvent [MEMORY] hold= 462,384 used= 458,736 count= 57 avg_used= 8,048 block_cnt= 57 chunk_cnt= 20 mod=[T]ObPerfEventR [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 393,216 used= 376,752 count= 6 avg_used= 62,792 block_cnt= 6 chunk_cnt= 6 mod=CommSysVarFac [MEMORY] hold= 385,024 used= 377,120 count= 1 avg_used= 377,120 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 2 mod=bf_queue [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 272,000 used= 269,824 count= 34 avg_used= 7,936 block_cnt= 34 chunk_cnt= 7 mod=LinearHashMapNo [MEMORY] hold= 262,144 used= 261,632 count= 4 avg_used= 65,408 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 240,000 used= 238,080 count= 30 avg_used= 7,936 block_cnt= 30 chunk_cnt= 5 mod=LockWaitMgr [MEMORY] hold= 212,992 used= 212,160 count= 1 avg_used= 212,160 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 200,704 used= 196,608 count= 64 avg_used= 3,072 block_cnt= 32 chunk_cnt= 4 mod=TxCtxMgr [MEMORY] hold= 181,440 used= 178,560 count= 45 avg_used= 3,968 block_cnt= 23 chunk_cnt= 6 mod=TinyAllocator [MEMORY] hold= 168,000 used= 166,656 count= 21 avg_used= 7,936 block_cnt= 21 chunk_cnt= 13 mod=LSIter [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=MemtableSetBkt [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 106,496 used= 98,432 count= 1 avg_used= 98,432 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 98,304 used= 97,760 count= 1 avg_used= 97,760 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 7 mod=SqlSession [MEMORY] hold= 88,000 used= 87,296 count= 11 avg_used= 7,936 block_cnt= 11 chunk_cnt= 8 mod=PartCtx [MEMORY] hold= 81,920 used= 65,536 count= 2 avg_used= 32,768 block_cnt= 2 chunk_cnt= 1 mod=CsDictPl [MEMORY] hold= 78,720 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 7 mod=HashNodeLCSta [MEMORY] hold= 78,720 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 6 mod=TabletIDSetNode [MEMORY] hold= 74,960 used= 36,624 count= 523 avg_used= 70 block_cnt= 159 chunk_cnt= 32 mod=Coro [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoMgr [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 72,768 used= 71,424 count= 7 avg_used= 10,203 block_cnt= 7 chunk_cnt= 4 mod=NotParamInfo [MEMORY] hold= 72,240 used= 1,024 count= 896 avg_used= 1 block_cnt= 10 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 72,000 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 8 mod=SqlSessiVarMap [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 56,832 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 2 mod=HB_SERVICE [MEMORY] hold= 49,152 used= 49,088 count= 1 avg_used= 49,088 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 48,832 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 48,784 used= 44,792 count= 2 avg_used= 22,396 block_cnt= 2 chunk_cnt= 2 mod=Autoincrement [MEMORY] hold= 48,000 used= 47,616 count= 6 avg_used= 7,936 block_cnt= 6 chunk_cnt= 6 mod=PlanVaIdx [MEMORY] hold= 45,632 used= 41,664 count= 62 avg_used= 672 block_cnt= 29 chunk_cnt= 12 mod=[T]ObWarningBuf [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=ConstPl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=CsStrPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=CsIntPl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=RawPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=DictPl [MEMORY] hold= 40,000 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 2 mod=ObDMMDL [MEMORY] hold= 40,000 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 4 mod=MdsTableMgr [MEMORY] hold= 39,360 used= 39,040 count= 5 avg_used= 7,808 block_cnt= 5 chunk_cnt= 4 mod=HashNodePlanCac [MEMORY] hold= 35,200 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 10 chunk_cnt= 6 mod=CACHE_INST [MEMORY] hold= 32,768 used= 17,408 count= 2 avg_used= 8,704 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTTP [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 25,664 count= 1 avg_used= 25,664 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 32,576 used= 25,103 count= 2 avg_used= 12,551 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 31,680 used= 27,456 count= 66 avg_used= 416 block_cnt= 32 chunk_cnt= 7 mod=OMT_Worker [MEMORY] hold= 31,424 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 25,264 used= 6,120 count= 255 avg_used= 24 block_cnt= 97 chunk_cnt= 20 mod=[T]MemoryContex [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=IntDiffPl [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=RlePl [MEMORY] hold= 24,240 used= 20,136 count= 2 avg_used= 10,068 block_cnt= 2 chunk_cnt= 2 mod=TabletStats [MEMORY] hold= 24,208 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 24,000 used= 23,808 count= 3 avg_used= 7,936 block_cnt= 3 chunk_cnt= 1 mod=TableScanIter [MEMORY] hold= 23,904 used= 23,712 count= 3 avg_used= 7,904 block_cnt= 3 chunk_cnt= 2 mod=SqlSessionSbloc [MEMORY] hold= 23,568 used= 23,376 count= 3 avg_used= 7,792 block_cnt= 3 chunk_cnt= 3 mod=CkptDgnMemNode [MEMORY] hold= 20,160 used= 19,840 count= 5 avg_used= 3,968 block_cnt= 4 chunk_cnt= 3 mod=CkpDgn [MEMORY] hold= 18,320 used= 16,896 count= 22 avg_used= 768 block_cnt= 22 chunk_cnt= 8 mod=TGTimer [MEMORY] hold= 16,768 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 3 chunk_cnt= 2 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ColSubStrPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ColEqualPl [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TblCtxIMgr [MEMORY] hold= 16,384 used= 13,824 count= 1 avg_used= 13,824 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=StrPrefixPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=HexStrPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=StrDiffPl [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 2 mod=TltMemtablMgr [MEMORY] hold= 15,712 used= 15,584 count= 2 avg_used= 7,792 block_cnt= 2 chunk_cnt= 1 mod=CkptDgnCUNode [MEMORY] hold= 11,728 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 1 mod=StopWordSet [MEMORY] hold= 10,240 used= 10,112 count= 2 avg_used= 5,056 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 9,216 used= 9,080 count= 2 avg_used= 4,540 block_cnt= 2 chunk_cnt= 2 mod=GCMemtableMap [MEMORY] hold= 9,120 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 1 mod=FTPluginMap [MEMORY] hold= 8,320 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,320 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 7,968 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,792 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,776 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,696 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 5,184 used= 5,120 count= 1 avg_used= 5,120 block_cnt= 1 chunk_cnt= 1 mod=CtxBlockPl [MEMORY] hold= 4,800 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,288 used= 3,899 count= 6 avg_used= 649 block_cnt= 5 chunk_cnt= 2 mod=SqlSessiQuerSql [MEMORY] hold= 4,160 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 4,160 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=CsCtxBlockPl [MEMORY] hold= 3,136 used= 3,072 count= 1 avg_used= 3,072 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 3,072 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 3,056 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=PackStateMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=ContextsMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=SequenceMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 4 mod=SequenceIdMap [MEMORY] hold= 2,944 used= 2,624 count= 5 avg_used= 524 block_cnt= 5 chunk_cnt= 3 mod=NotParamIdex [MEMORY] hold= 2,400 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,304 used= 1,792 count= 8 avg_used= 224 block_cnt= 6 chunk_cnt= 4 mod=LogIOTask [MEMORY] hold= 2,240 used= 1,920 count= 5 avg_used= 384 block_cnt= 5 chunk_cnt= 5 mod=TableLockNode [MEMORY] hold= 1,920 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 1,920 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,728 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 1,664 used= 1,600 count= 1 avg_used= 1,600 block_cnt= 1 chunk_cnt= 1 mod=LogPartFetCtxPo [MEMORY] hold= 1,616 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,616 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,600 used= 40 count= 20 avg_used= 2 block_cnt= 20 chunk_cnt= 13 mod=[T]TSIUseWeak [MEMORY] hold= 1,488 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,408 used= 1,280 count= 2 avg_used= 640 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,344 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,344 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,264 used= 864 count= 6 avg_used= 144 block_cnt= 6 chunk_cnt= 3 mod=ObTxLSLogCb [MEMORY] hold= 1,152 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,120 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,024 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 848 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 848 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=HashBucPsSessIn [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 720 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 624 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 544 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 480 used= 120 count= 5 avg_used= 24 block_cnt= 1 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 448 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 288 used= 216 count= 1 avg_used= 216 block_cnt= 1 chunk_cnt= 1 mod=memtable_set [MEMORY] hold= 288 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 288 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 272 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 224 used= 64 count= 2 avg_used= 32 block_cnt= 2 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 192 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 192 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 176 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 160 used= 16 count= 2 avg_used= 8 block_cnt= 2 chunk_cnt= 2 mod=ObLogEXTHandler [MEMORY] hold= 128 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 112 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 112 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 112 used= 48 count= 1 avg_used= 48 block_cnt= 1 chunk_cnt= 1 mod=[T]TSITabletTab [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=[T]TSIDDLVar [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=[T]TSILastOper [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 901,999,296 used= 894,350,036 count= 32,471 avg_used= 27,543 mod=SUMMARY [2024-06-24 16:58:29.320585] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=203] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 136,314,880 used= 135,249,920 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 135,249,920 used= 135,188,040 count= 65 avg_used= 2,079,816 block_cnt= 65 chunk_cnt= 65 mod=Memstore [MEMORY] hold= 135,249,920 used= 135,188,040 count= 65 avg_used= 2,079,816 mod=SUMMARY [2024-06-24 16:58:29.320609] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,496 count= 1 avg_used= 722,496 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,496 count= 1 avg_used= 722,496 mod=SUMMARY [2024-06-24 16:58:29.320647] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 140,509,184 used= 136,763,504 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 129,217,136 used= 117,812,699 count= 5,478 avg_used= 21,506 block_cnt= 5,478 chunk_cnt= 67 mod=SqlPhyPlan [MEMORY] hold= 5,543,104 used= 5,300,896 count= 529 avg_used= 10,020 block_cnt= 529 chunk_cnt= 67 mod=SqlPlanCache [MEMORY] hold= 2,001,536 used= 1,938,368 count= 977 avg_used= 1,984 block_cnt= 246 chunk_cnt= 66 mod=CreateContext [MEMORY] hold= 1,728 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 136,763,504 used= 125,053,563 count= 6,986 avg_used= 17,900 mod=SUMMARY [2024-06-24 16:58:29.320673] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,944 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,848 used= 59,018 count= 263 avg_used= 224 block_cnt= 20 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,944 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-06-24 16:58:29.320692] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 150,994,944 used= 147,603,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 147,603,456 used= 147,328,896 count= 286 avg_used= 515,136 block_cnt= 286 chunk_cnt= 72 mod=CoStack [MEMORY] hold= 147,603,456 used= 147,328,896 count= 286 avg_used= 515,136 mod=SUMMARY [2024-06-24 16:58:29.320719] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 232,783,872 used= 232,783,872 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 232,783,872 used= 0 count= 111 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 232,783,872 used= 0 count= 111 avg_used= 0 mod=SUMMARY [2024-06-24 16:58:29.320741] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 14,680,064 used= 13,148,160 limit= 3,650,722,200 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,552,448 used= 7,608,556 count= 116 avg_used= 65,591 block_cnt= 116 chunk_cnt= 6 mod=L_TabletPool [MEMORY] hold= 4,194,304 used= 4,186,112 count= 64 avg_used= 65,408 block_cnt= 64 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 13,148,160 used= 12,194,732 count= 182 avg_used= 67,004 mod=SUMMARY [2024-06-24 16:58:29.320760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 7,344,640 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 7,344,640 used= 7,285,248 count= 918 avg_used= 7,936 block_cnt= 918 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 7,344,640 used= 7,285,248 count= 918 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:29.320779] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 73,536 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=LobAllocator [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 73,536 used= 73,344 count= 2 avg_used= 36,672 mod=SUMMARY [2024-06-24 16:58:29.320796] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 33,600 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,600 used= 31,721 count= 26 avg_used= 1,220 block_cnt= 5 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 33,600 used= 31,721 count= 26 avg_used= 1,220 mod=SUMMARY [2024-06-24 16:58:29.320827] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 6,311,936 used= 5,870,656 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 3,182,528 used= 3,153,728 count= 3 avg_used= 1,051,242 block_cnt= 3 chunk_cnt= 3 mod=MEMTABLE_ARENA [MEMORY] hold= 2,680,128 used= 2,658,560 count= 335 avg_used= 7,936 block_cnt= 335 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 5,870,656 used= 5,820,224 count= 339 avg_used= 17,168 mod=SUMMARY [2024-06-24 16:58:29.320852] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 96,000 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 1 mod=MdsTable [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:29.320873] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= SCHEMA_SERVICE hold= 2,097,152 used= 8,000 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenCac [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:29.320894] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2024-06-24 16:58:29.320918] INFO [LIB] operator() (ob_malloc_allocator.cpp:542) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 2,043,682,816 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 301,744,128 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 8,388,608 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 178,257,920 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 10,485,760 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 12,582,912 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 112,066,560 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 193,744,896 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 1,220,120,576 limit= 9,223,372,036,854,775,807 [2024-06-24 16:58:29.321262] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 301,744,128 used= 256,636,896 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 26,984,448 used= 25,303,776 count= 366 avg_used= 69,136 block_cnt= 366 chunk_cnt= 41 mod=[T]ObSessionDIB [MEMORY] hold= 24,014,848 used= 23,941,952 count= 28 avg_used= 855,069 block_cnt= 28 chunk_cnt= 19 mod=IoControl [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,502,144 used= 10,477,568 count= 64 avg_used= 163,712 block_cnt= 64 chunk_cnt= 23 mod=Iteratorget_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=129587, mem_used=326519808) [2024-06-24 16:58:29.428379] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:29.430653] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=31] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:29.430705] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=51] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:29.430753] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:29.430908] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=38] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219517830421000, latest_log_ts:{val:1719219501198972001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:29.431041] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=128] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:29.431072] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:29.431097] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1719219501198972001, v:0}) [2024-06-24 16:58:29.431112] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:29.431127] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:29.431146] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:29.431178] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:29.431202] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:29.431219] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:29.434582] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=383, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:29.434610] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:29.440282] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2164) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:517604318}], scn_array=[cnt:1, {val:1719219509393599000, v:0}], curr_size=539, accum_size=5228, time_cost=46066) [2024-06-24 16:58:29.440335] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=5228) [2024-06-24 16:58:29.440384] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=5228) [2024-06-24 16:58:29.440429] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=3473, avg_log_submit_to_slide_time=3482) [2024-06-24 16:58:29.449928] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.455033] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF25-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219509454755000, start_id=1719219509454755000, end_id=1719219509454755001) [2024-06-24 16:58:29.460222] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:29.460285] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=398, avg_log_submit_to_slide_time=413) [2024-06-24 16:58:29.474609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.477912] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB3E-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103405569285, cache_obj->added_lc()=false, cache_obj->get_object_id()=9348, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:29.479588] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:29.500842] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=35] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:29.502151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:29.502697] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:29.502810] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=35] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506692887000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:29.504974] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1719219509504959, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-06-24 16:58:29.511535] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1AFD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:29.514760] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10738CE-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:29.517761] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219509517290000, start_id=1719219509517290000, end_id=1719219509517290001) [2024-06-24 16:58:29.520342] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10738D0-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:29.523308] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10738D1-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:29.524252] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=22] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13716, offset=3444598}, end_cursor:ObLogCursor{file_id=1, log_id=13717, offset=3444871}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fe8050, len:4234, log_data_len:273, seq:13716, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:29.526162] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1B0D-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:29.527866] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D904-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219509526860000, start_id=1719219509526860000, end_id=1719219509526860001) [2024-06-24 16:58:29.528364] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7775) [2024-06-24 16:58:29.528416] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7775) [2024-06-24 16:58:29.528456] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1010, avg_log_submit_to_slide_time=1022) [2024-06-24 16:58:29.529063] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=35] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13717, offset=3444871}, end_cursor:ObLogCursor{file_id=1, log_id=13718, offset=3445136}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9fec050, len:3961, log_data_len:265, seq:13717, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:29.530840] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1192][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=50] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:29.539961] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=25] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:29.543983] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219509543833000, start_id=1719219509543833000, end_id=1719219509543833001) [2024-06-24 16:58:29.549987] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=32][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.550861] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1B26-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:29.554054] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10738EC-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:29.556921] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219509556580000, start_id=1719219509556580000, end_id=1719219509556580001) [2024-06-24 16:58:29.558412] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1B2D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:29.561094] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:29.561205] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:29.561412] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:29.561473] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:29.561646] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:29.561720] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:29.561820] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC2-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:29.572196] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BC3-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:29.574635] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.581102] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219509581002000, start_id=1719219509581002000, end_id=1719219509581002001) [2024-06-24 16:58:29.581141] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:29.581159] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=10] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:29.581567] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=409, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:29.581589] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=13, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:29.581611] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:29.581663] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=463, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:29.581680] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:29.604339] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219509603333000, start_id=1719219509603333000, end_id=1719219509603333001) [2024-06-24 16:58:29.611840] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BD0-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:29.612591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283278667776, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:29.613530] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD729-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.613538] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C45-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.613891] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1B95-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.613901] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BCFFB-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.613906] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A76-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.613977] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF49-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.614183] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256BF6-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.614202] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073927-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.614208] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E81FFA-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.615158] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BD1-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:29.619415] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:29.620402] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:29.621519] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BA4-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.621552] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107392F-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.621592] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FDB-0-0] [lt=35][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.621600] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A7D-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.621617] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256BFD-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.626850] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C50-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.627004] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FE4-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.627060] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073935-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.627109] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A85-0-0] [lt=37][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.628612] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BB5-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.629604] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF51-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.631757] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FEA-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.632921] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A8E-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.634021] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A8F-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.634518] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [728][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B511C8E-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.635110] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD731-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.635427] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BC4-0-0] [lt=41][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.635738] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A91-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.635760] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C05-0-0] [lt=41][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.636297] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BC6-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.636678] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107393F-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.636996] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BC8-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.637519] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BC9-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.637574] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073941-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.637979] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BCA-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.638129] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6A97-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.640988] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD00C-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.641084] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82001-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.641765] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107394B-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.642204] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BD7-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.642543] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107394F-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.643057] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BD9-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.643363] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD73A-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.643674] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=33] success to update min reserved snapshot(reserved_snapshot=1719217706800618000, duration=1800, snapshot_gc_ts=1719219506800618000) [2024-06-24 16:58:29.644135] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD73B-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.644406] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217706800618000) [2024-06-24 16:58:29.644432] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=22] update reserved snapshot finished(cost_ts=774, reserved_snapshot=1719217706800618000) [2024-06-24 16:58:29.644939] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD73D-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.645690] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C65-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.645737] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073958-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.646249] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD740-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.646284] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107395A-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.646931] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C69-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.647052] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD741-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.647533] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C13-0-0] [lt=44][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.648175] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FF1-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.649900] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BEE-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.650046] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.650323] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107396A-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.651214] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BF3-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.651480] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107396D-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.651468] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C6D-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.651513] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82005-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.651581] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6ABB-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.652136] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82006-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.652251] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C6E-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.652298] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BF5-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.653144] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82008-0-0] [lt=55][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.653518] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BF9-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.653717] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FF3-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.653772] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD01B-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.654110] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF63-0-0] [lt=43][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.654221] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD01C-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.654234] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1BFA-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.654436] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC1299F-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.655028] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073980-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.655807] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C79-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.656343] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073983-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.656575] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1168FF9-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.656910] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8200D-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.656942] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C02-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.657434] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8200F-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.658147] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD75A-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.658425] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C07-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.658947] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD75C-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.658973] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C08-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.659265] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF66-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.660093] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C84-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.660495] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=402, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:29.660527] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:29.660526] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:29.660555] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:29.660577] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:29.660601] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:29.660651] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=485, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:29.660668] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=463, avg_log_submit_to_slide_time=471) [2024-06-24 16:58:29.660689] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=23, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:29.660769] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C86-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.660803] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD760-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.660850] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82011-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.660948] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C0D-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.661472] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C0E-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.661552] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC15246-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.662475] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6ACC-0-0] [lt=17][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.662544] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10739A0-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.663783] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF6C-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.664060] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6ACF-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.664215] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C16-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.664918] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD769-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.665791] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10739AA-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.665854] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82013-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.666130] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C1B-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.666139] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6AD2-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.666521] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF70-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.666557] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10739AC-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.666873] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6AD4-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.667478] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041C93-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.667698] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C6AD5-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.667999] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C31-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.669192] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:29.670358] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169006-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.670826] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82018-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.671222] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C2B-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.671240] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD03C-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.671879] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C2C-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.672001] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD76F-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.672429] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10739BB-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.672923] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD770-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.673813] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041CA2-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.674347] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C32-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.674693] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.674826] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C33-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.677575] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041CA6-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.681896] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95BE3-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:29.686811] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1C42-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.690433] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=44] LogLoopThread round_cost_time(us)(round_cost_time=17) [2024-06-24 16:58:29.690768] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=34] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:29.699402] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=28] gc stale ls task succ [2024-06-24 16:58:29.702250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:29.703439] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [1204][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=52] BlockGCTimerTask success(ret=0, cost_time_us=7, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1004", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):44236, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):44236, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):226, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:29.716261] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:29.716312] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=36] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1237) [2024-06-24 16:58:29.718127] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:29.718392] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219509717434000, start_id=1719219509717434000, end_id=1719219509717434001) [2024-06-24 16:58:29.721637] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:29.721672] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=26] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:29.721709] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=103028086, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:29.722392] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=11424, mem_used=89428992) [2024-06-24 16:58:29.729453] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:29.745025] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E13844-0-0] [lt=18] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336743803024291992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.886405955689659208e+01) [2024-06-24 16:58:29.745276] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=56] get number(ret=0, service_type_=0, range=1, base_id=1719219509744860000, start_id=1719219509744860000, end_id=1719219509744860001) [2024-06-24 16:58:29.745769] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8352) [2024-06-24 16:58:29.750106] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.753295] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [163826][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=35] report RowHolderMapper summary info(count=2620, bkt_cnt=7851) [2024-06-24 16:58:29.757036] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219509756476000, start_id=1719219509756476000, end_id=1719219509756476001) [2024-06-24 16:58:29.766955] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=35] new mysql sessid created(conn.sessid_=3221494459, support_ssl=false) [2024-06-24 16:58:29.767034] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221494459, sess.client_addr_="172.20.17.86:49494") [2024-06-24 16:58:29.767058] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494459, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:29.767151] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494459, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:29.767184] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=29] kill and revert session(conn.sessid_=3221494459, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:29.767204] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=19] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494459, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:29.767228] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494459) [2024-06-24 16:58:29.767242] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494459, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:29.769255] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1098) [2024-06-24 16:58:29.769295] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=368, avg_log_submit_to_slide_time=381) [2024-06-24 16:58:29.770175] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:29.770220] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=33] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:29.770243] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=20] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:29.770259] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=14] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1216) [2024-06-24 16:58:29.774747] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.780634] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C20-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:29.782267] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C21-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:29.782301] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=7] get number(ret=0, service_type_=0, range=1, base_id=1719219509781803000, start_id=1719219509781803000, end_id=1719219509781803001) [2024-06-24 16:58:29.785362] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C23-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:29.787001] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C24-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:29.788549] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C25-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:29.803229] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1CB0-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:29.804391] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C2C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:29.804537] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219509803973000, start_id=1719219509803973000, end_id=1719219509803973001) [2024-06-24 16:58:29.807310] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C2D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:29.811500] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C2F-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:29.813158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283268161536, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:29.814486] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:29.814575] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:29.814745] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:29.814796] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:29.814917] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:29.814973] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:29.815054] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C31-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:29.820592] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16469, offset=3751343}, end_cursor:ObLogCursor{file_id=1, log_id=16470, offset=3751616}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ff0050, len:593, log_data_len:273, seq:16469, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:29.824351] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=10] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=20, mem_used=49913856) [2024-06-24 16:58:29.824374] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] release old cannot free more memory [2024-06-24 16:58:29.824383] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=33, size_used=0, mem_used=49913856) [2024-06-24 16:58:29.824581] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F5-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219509824034000, start_id=1719219509824034000, end_id=1719219509824034001) [2024-06-24 16:58:29.824700] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F5-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7763, avg_group_log_size=646) [2024-06-24 16:58:29.824735] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F5-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7763) [2024-06-24 16:58:29.825136] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=7] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7763) [2024-06-24 16:58:29.825198] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=455, avg_log_submit_to_slide_time=466) [2024-06-24 16:58:29.825826] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16470, offset=3751616}, end_cursor:ObLogCursor{file_id=1, log_id=16471, offset=3751881}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ff4050, len:4416, log_data_len:265, seq:16470, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:29.827909] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C32-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4565, pos=3045, bitmap=NULL) [2024-06-24 16:58:29.829428] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219509829313000, start_id=1719219509829313000, end_id=1719219509829313001) [2024-06-24 16:58:29.829460] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=30] handle gts request statistics(total_rt=889, total_cnt=101, avg_rt=8.715686274509803155e+00, avg_cnt=1.009999999999999964e+01) [2024-06-24 16:58:29.829498] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=31] ts response task statistics(alloc_count=247958, free_count=123978) [2024-06-24 16:58:29.829526] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219509829419], gts:1719219509829313000, latest_srr:[mts=1719219509829419]}) [2024-06-24 16:58:29.829571] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219509829550], gts:1719219509829313000, latest_srr:[mts=1719219509829550]}) [2024-06-24 16:58:29.829620] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=16] submit log success(service_type_=0, last_id=1719219526480480000, limited_id=1719219526480480000) [2024-06-24 16:58:29.829649] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=28] submit log with lock success(service_type_=0, last_id=1719219526480480000, limited_id=1719219526480480000) [2024-06-24 16:58:29.829678] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219509829588], gts:1719219509829313000, latest_srr:[mts=1719219509829588]}) [2024-06-24 16:58:29.829712] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219509829695], gts:1719219509829313000, latest_srr:[mts=1719219509829695]}) [2024-06-24 16:58:29.830018] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9B19EF41-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1719219526480480000, latest_scn={val:1719219509829313001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219507372008000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:29.830107] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9B19EF41-0-0] [lt=87] handle submit callback(service_type_=0, success=true, used_ts=487, log_ts={val:1719219509829313001, v:0}, limited_id=1719219526480480000) [2024-06-24 16:58:29.830133] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9B19EF41-0-0] [lt=25] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:29.830151] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9B19EF41-0-0] [lt=17] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:29.850166] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.855182] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] get_max_applied_scn(scn={val:1719219509502383001, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:517608963}, palf_committed_end_scn_:{val:1719219509502383002, v:0}, last_check_scn_:{val:1719219509502383002, v:0}, max_applied_cb_scn_:{val:1719219509502383001, v:0}}) [2024-06-24 16:58:29.855712] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=22] current monitor number(seq_=-1) [2024-06-24 16:58:29.862679] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C40-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:29.865610] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C41-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:29.873419] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873661] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873785] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873791] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873843] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.873941] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874131] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874297] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874373] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874417] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874520] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874527] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874728] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874773] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.874803] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.874886] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:29.875312] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1719219509875305, bytes: 170566359, bw: 0.018589 MB/s, add_ts: 1007617, add_bytes: 19640 [2024-06-24 16:58:29.886182] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D063-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:29.886446] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D063-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219509886416, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:29.886488] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D063-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1719219509886122}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219509886416, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:29.902347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:29.910933] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:29.914295] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C55-0-0] [lt=43][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:29.918483] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219509917862000, start_id=1719219509917862000, end_id=1719219509917862001) [2024-06-24 16:58:29.945331] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219509945314000, start_id=1719219509945314000, end_id=1719219509945314001) [2024-06-24 16:58:29.950224] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.957176] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219509956915000, start_id=1719219509956915000, end_id=1719219509956915001) [2024-06-24 16:58:29.960209] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:29.960249] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:29.960277] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:29.960300] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:29.960347] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:29.960366] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:29.960911] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=402, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:29.974860] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:29.982404] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219509982242000, start_id=1719219509982242000, end_id=1719219509982242001) [2024-06-24 16:58:30.002258] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:30.003514] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219510003369000, start_id=1719219510003369000, end_id=1719219510003369001) [2024-06-24 16:58:30.004099] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:30.006452] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [1462][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=55] BlockGCTimerTask success(ret=0, cost_time_us=7, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1003", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):4915, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):4915, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):134, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:30.011065] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=18] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:30.011114] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=36] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1237) [2024-06-24 16:58:30.013551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283272376320, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:30.022307] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 427.50) [2024-06-24 16:58:30.022339] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:30.022441] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 443.50) [2024-06-24 16:58:30.022458] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:30.022491] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022512] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022527] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022541] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022555] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022569] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022585] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022599] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022613] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022646] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022661] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022676] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022688] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022702] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022716] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.022730] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:30.035655] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FBFB-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103406127019, cache_obj->added_lc()=false, cache_obj->get_object_id()=9349, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:30.036840] WDIAG get_refactored (ob_hashtable.h:1102) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FBFD-0-0] [lt=35][errcode=-4201] hashtable not init [2024-06-24 16:58:30.036862] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FBFD-0-0] [lt=20][errcode=-4016] get cursor info failed(cursor_id=1148, get_sessid()=3221489125) [2024-06-24 16:58:30.036997] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219510036112000, start_id=1719219510036112000, end_id=1719219510036112001) [2024-06-24 16:58:30.050282] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.053317] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=30] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:30.060241] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] tx gc loop thread is running(MTL_ID()=1004) [2024-06-24 16:58:30.060263] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] try gc retain ctx [2024-06-24 16:58:30.060296] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] get_max_applied_scn(scn={val:1719219509829313001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:45063578}, palf_committed_end_scn_:{val:1719219509829313001, v:0}, last_check_scn_:{val:1719219509829313001, v:0}, max_applied_cb_scn_:{val:1719219509829313001, v:0}}) [2024-06-24 16:58:30.060332] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=32] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:30.062701] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=102] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219507324493004, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:30.065043] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=41] LogLoopThread round_cost_time(us)(round_cost_time=16) [2024-06-24 16:58:30.065093] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=114] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219507324493004, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:30.066241] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:30.066261] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:30.066290] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=532, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:30.066310] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:30.069023] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:30.069060] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:30.069093] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:30.069116] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:30.069403] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=334, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:30.069423] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=11, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:30.069448] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:30.069473] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=401, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:30.069489] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=28, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:30.069633] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=3055, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:30.069660] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:30.069679] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:30.069694] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=3123, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:30.069707] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=20, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:30.074915] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.080453] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [713][T1002_L0_G0][T1002][YB42AC141156-00061B9D92E11DBB-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:30.083536] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C8E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:30.089188] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C90-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:30.091925] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=49] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:30.092162] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C91-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:30.094180] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=328, mem_used=2079744) [2024-06-24 16:58:30.095168] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C92-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:30.096274] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=58] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096422] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096502] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096656] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096663] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096655] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=54] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096755] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=56] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096870] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096879] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.096994] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097109] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097139] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097141] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097162] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097182] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=72] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097309] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097312] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097497] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=167] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097497] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097505] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=53] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097562] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097612] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=71] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097619] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097657] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=58] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=63] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097668] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097767] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=55] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097771] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097786] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=64] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097819] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.097827] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=73] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098085] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098284] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098308] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098480] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098475] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=50] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098716] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098770] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098783] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098794] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.098906] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.102430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:30.103198] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [162977][T1_ArcSender][T1][YB42AC141156-00061B9D8760C0E5-0-0] [lt=24][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:30.110921] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:30.110944] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:30.110974] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=73476665, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:30.111199] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=24] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:67423, max_lsn:53436162, max_scn:{val:1719219510036112000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:53436162}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:11493122}}, last_submit_lsn:{lsn:53435603}, last_submit_end_lsn:{lsn:53436162}, last_submit_log_id:67423, last_submit_log_pid:1, max_flushed_lsn:{lsn:53435603}, max_flushed_end_lsn:{lsn:53436162}, max_flushed_log_pid:1, committed_end_lsn:{lsn:53436162}, last_slide_log_id:67423, last_slide_scn:{val:1719219510036112000, v:0}, last_slide_lsn:{lsn:53435603}, last_slide_end_lsn:{lsn:53436162}, last_slide_log_pid:1, last_slide_log_accum_checksum:1248531513, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f47b6888530}, [StateMgr]={this:0x7f47b688c2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:67424, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213258395201, palf_role_change_cb:0x7f47b6892cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f47b6889c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1/1/meta", dir_fd:657, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f47b688e478, flashback_version:0}, log_storage:{log_tail:{lsn:53436162}, readable_log_tail:{lsn:53436162}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1/1/log", dir_fd:658, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:13668606, block_header_serialize_buf_:0x7f47b6890138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213258395305, this:0x7f47b688c9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213258395809, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f47b688c430}) [2024-06-24 16:58:30.111567] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=362] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219510037418, last_flushed_end_lsn:{lsn:53436162}}]) [2024-06-24 16:58:30.111596] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=67424, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219510037418, last_flushed_end_lsn:{lsn:53436162}}]) [2024-06-24 16:58:30.111863] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163142][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1A-0-0] [lt=21] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:30.111905] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163142][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1A-0-0] [lt=33] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=52) [2024-06-24 16:58:30.117370] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=30] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:30.117400] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=21] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:30.117415] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=13] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:30.117425] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=9] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1229) [2024-06-24 16:58:30.118347] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [162968][T1_TenantWeakRe][T1][YB42AC141156-00061B9D89B1392A-0-0] [lt=29] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=196) [2024-06-24 16:58:30.118605] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219510118469000, start_id=1719219510118469000, end_id=1719219510118469001) [2024-06-24 16:58:30.119191] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4206) [2024-06-24 16:58:30.119220] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=449, avg_log_submit_to_slide_time=462) [2024-06-24 16:58:30.120901] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C9B-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:30.123952] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C9D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:30.128790] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95C9F-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:30.131795] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:30.131901] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:30.132106] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:30.132167] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:30.132329] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:30.132401] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:30.132503] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA1-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:30.132878] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:30.134670] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8ED-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:30.134704] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8ED-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:30.134929] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D2-0-0] [lt=16] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:30.134955] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D2-0-0] [lt=24] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:30.145182] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CA2-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:30.145432] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219510144892000, start_id=1719219510144892000, end_id=1719219510144892001) [2024-06-24 16:58:30.150344] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.157283] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219510156518000, start_id=1719219510156518000, end_id=1719219510156518001) [2024-06-24 16:58:30.157358] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:30.157393] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:30.169091] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1104, avg_group_log_size=122) [2024-06-24 16:58:30.169125] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1104) [2024-06-24 16:58:30.169172] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=7848, avg_group_log_size=461) [2024-06-24 16:58:30.169194] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7848) [2024-06-24 16:58:30.174474] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=38] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:30.174970] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.175858] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D422-0-0] [lt=25] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:30.182495] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219510181887000, start_id=1719219510181887000, end_id=1719219510181887001) [2024-06-24 16:58:30.188891] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D89E-0-0] [lt=52][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:30.190368] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:30.192144] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:30.192248] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506784804000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:30.199713] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CB0-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:30.200991] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=16] gc stale ls task succ [2024-06-24 16:58:30.202750] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CB1-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:30.203647] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219510203030000, start_id=1719219510203030000, end_id=1719219510203030001) [2024-06-24 16:58:30.210979] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [939][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=23] report RowHolderMapper summary info(count=2620, bkt_cnt=7836) [2024-06-24 16:58:30.214003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283270279168, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:30.220188] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [803][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:30.220551] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D472-0-0] [lt=14] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:30.230029] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=211515, mem_used=436746240) [2024-06-24 16:58:30.233137] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=10] ====== checkpoint timer task ====== [2024-06-24 16:58:30.233180] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=21] get_max_applied_scn(scn={val:1719219510144892000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:73477843}, palf_committed_end_scn_:{val:1719219510181887000, v:0}, last_check_scn_:{val:1719219510181887000, v:0}, max_applied_cb_scn_:{val:1719219510144892000, v:0}}) [2024-06-24 16:58:30.233218] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=34] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:30.234663] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:30.234709] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4206, avg_group_log_size=350) [2024-06-24 16:58:30.234737] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4206) [2024-06-24 16:58:30.234760] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:30.235119] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4206) [2024-06-24 16:58:30.235184] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:30.235203] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=479, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:30.235216] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=27, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:30.235438] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=104] succ to get rec scn(*this={this:0x7f46f0604030, ls_id:{id:1}, tenant_id:1003, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216321111181000, v:0}, last_push_gc_task_ts_:1719216953731290, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:30.235476] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=37] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46f1df0080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216953736744, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46f1df0080, snapshot_version:{val:1719216953736744, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:30.235521] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=37] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:30.235677] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:30.235796] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=114] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46f1d8d790}, min_rec_scn={val:1719216953754927000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:30.235825] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:30.235847] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219507943313001, v:0}) [2024-06-24 16:58:30.235861] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:30.235875] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:30.235895] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216953754927000, v:0}, checkpoint_scn_in_ls_meta={val:1719216953754927000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:30.235928] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:30.235951] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:30.235968] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:30.250403] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.252876] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=14] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:30.252920] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=33] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:30.252942] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1236) [2024-06-24 16:58:30.255460] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CC3-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:30.268303] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=83] tx gc loop thread is running(MTL_ID()=1003) [2024-06-24 16:58:30.268325] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=21] try gc retain ctx [2024-06-24 16:58:30.270396] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=9] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1003, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:30.275026] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.276131] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=17] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:30.276162] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=30] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:30.276171] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C724-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:30.276211] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C724-0-0] [lt=33] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:30.302514] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:30.304682] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [348][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2024-06-24 16:58:30.304823] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5B9-0-0] [lt=22] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219507372008000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:30.304961] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5B9-0-0] [lt=87] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219507372008000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:30.305031] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5B9-0-0] [lt=68] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:30.318669] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219510318217000, start_id=1719219510318217000, end_id=1719219510318217001) [2024-06-24 16:58:30.330457] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219510329831000, start_id=1719219510329831000, end_id=1719219510329831001) [2024-06-24 16:58:30.330501] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:30.330903] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=50] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2024-06-24 16:58:30.331754] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:397) [162151][ServerTracerTim][T0][YB42AC141156-00061B9D86E0C5C9-0-0] [lt=28] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-06-24 16:58:30.332814] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=33] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1004) [2024-06-24 16:58:30.332842] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1001) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=26] no transfer partition job [2024-06-24 16:58:30.332863] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1031) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=16] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer={value_str:"True"}) [2024-06-24 16:58:30.336518] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=20] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1004, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2024-06-24 16:58:30.336576] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:482) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=43] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2024-06-24 16:58:30.340104] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2024-06-24 16:58:30.340197] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34A-0-0] [lt=28] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1004, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1002, status:0}], ls_array_=[{tenant_id:1004, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1002, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1719213373528854, last_statistic_bg_stat_time=1719216987199453, last_statistic_schema_version=1719216919372024, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2024-06-24 16:58:30.341652] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:30.345524] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219510344612000, start_id=1719219510344612000, end_id=1719219510344612001) [2024-06-24 16:58:30.346159] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1003, new_min_version={val:1719219510181887000, v:0}, new_max_version={val:1719219510181887000, v:0}, last_min_version={val:1719219509945314000, v:0}, last_max_version={val:1719219509945314000, v:0}, total_time_us=2614, delta_us=164271) [2024-06-24 16:58:30.346202] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219510181887000, v:0}, min_version={val:1719219510181887000, v:0}, max_version={val:1719219510181887000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:30.346259] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] [WRS] update tenant weak read server version(tenant_id=1003, server_version={version:{val:1719219510181887000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1719219510346228}, version_delta=164371) [2024-06-24 16:58:30.350464] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.356340] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219510356151000, start_id=1719219510356151000, end_id=1719219510356151001) [2024-06-24 16:58:30.360494] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=87] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:30.360528] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:30.374852] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [960][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:30.375081] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.375036] INFO [MDS] flush (mds_table_mgr.cpp:172) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5B9-0-0] [lt=30] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219517830421000, latest_log_ts:{val:1719219501198972001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:30.375172] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5B9-0-0] [lt=130] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:30.382609] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219510382544000, start_id=1719219510382544000, end_id=1719219510382544001) [2024-06-24 16:58:30.403549] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1364][T1004_LCLSender][T1004][Y0-0000000000000000-0-0] [lt=36] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47231fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:30.403752] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219510403631000, start_id=1719219510403631000, end_id=1719219510403631001) [2024-06-24 16:58:30.404162] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=943, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:30.404197] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:30.404228] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:30.404259] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1008, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:30.404279] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=27, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:30.414471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283266084864, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:30.419255] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129604, mem_used=326519808) [2024-06-24 16:58:30.422412] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2024-06-24 16:58:30.423440] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [703][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CB94CDC-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:30.424451] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219510423650000, start_id=1719219510423650000, end_id=1719219510423650001) [2024-06-24 16:58:30.424536] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8319, avg_group_log_size=639) [2024-06-24 16:58:30.424565] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8363) [2024-06-24 16:58:30.425966] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=28] run rewrite rule refresh task(rule_mgr_->tenant_id_=1003) [2024-06-24 16:58:30.426602] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CFC-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:30.427944] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219510427877000, start_id=1719219510427877000, end_id=1719219510427877001) [2024-06-24 16:58:30.432457] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CFE-0-0] [lt=54][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:30.433954] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:30.434155] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [162311][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=25] runTimer to refresh locality_info(ret=0) [2024-06-24 16:58:30.435139] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=405, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:30.435169] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=16, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:30.435466] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95CFF-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:30.435751] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:30.435856] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506733030000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:30.436107] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=35] set_server_locality_array success(server_locality_array=[{inited:true, addr:"172.20.17.86:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1719213306412144, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2024-06-24 16:58:30.436163] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=44] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2024-06-24 16:58:30.436180] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2024-06-24 16:58:30.436195] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=11] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2024-06-24 16:58:30.436203] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=7] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2024-06-24 16:58:30.436224] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=10] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2024-06-24 16:58:30.436234] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=10] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2024-06-24 16:58:30.436244] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=9] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1003, primary_zone=RANDOM) [2024-06-24 16:58:30.436254] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=10] add_locality_zone success(locality_zone={tenant_id:1003, region_priority:18446744073709551615}) [2024-06-24 16:58:30.436264] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=9] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1004, primary_zone=RANDOM) [2024-06-24 16:58:30.436275] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=10] add_locality_zone success(locality_zone={tenant_id:1004, region_priority:18446744073709551615}) [2024-06-24 16:58:30.436287] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=8] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}, {tenant_id:1003, region_priority:18446744073709551615}, {tenant_id:1004, region_priority:18446744073709551615}]}) [2024-06-24 16:58:30.438546] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D00-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:30.446968] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=65] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:30.450523] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.456289] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:30.458271] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1004) [2024-06-24 16:58:30.459108] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F1B-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219510458478000, start_id=1719219510458478000, end_id=1719219510458478001) [2024-06-24 16:58:30.459516] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=9] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=5377) [2024-06-24 16:58:30.459560] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=5377) [2024-06-24 16:58:30.459606] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=404, avg_log_submit_to_slide_time=414) [2024-06-24 16:58:30.460316] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219510459535000, start_id=1719219510459535000, end_id=1719219510459535001) [2024-06-24 16:58:30.461039] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1211) [2024-06-24 16:58:30.461079] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=525, avg_log_submit_to_slide_time=538) [2024-06-24 16:58:30.464020] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F1F-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:30.466714] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F22-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:30.471411] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:30.474536] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:30.474662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:30.474877] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:30.474944] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:30.475091] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.475108] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:30.475184] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:30.475288] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:30.479719] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:30.483866] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FBFE-0-0] [lt=16][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103406575233, cache_obj->added_lc()=false, cache_obj->get_object_id()=9350, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:30.487722] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D0D-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:30.488824] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2024-06-24 16:58:30.490881] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219510490180000, start_id=1719219510490180000, end_id=1719219510490180001) [2024-06-24 16:58:30.493051] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=38] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:30.497672] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D438-0-0] [lt=15] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:30.502603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:30.512578] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1719219510512575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-06-24 16:58:30.516761] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1719219510318217000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198538, in_cluster_service=true, cluster_version={val:1719219510118469000, v:0}, min_cluster_version={val:1719219510118469000, v:0}, max_cluster_version={val:1719219510118469000, v:0}, get_cluster_version_err=0, cluster_version_delta=398286, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60420, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219313404268000, v:0}, local_cluster_delta=197112487, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:30.517305] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E922-0-0] [lt=20] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1719219510517284}) [2024-06-24 16:58:30.517350] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D064-0-0] [lt=28] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219510517321, sql_renew_time:1719219510517321, is_mark_fail:false}]) [2024-06-24 16:58:30.517395] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D064-0-0] [lt=44] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1719219510517284}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219510517321, sql_renew_time:1719219510517321, is_mark_fail:false}]) [2024-06-24 16:58:30.518819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=62] get number(ret=0, service_type_=0, range=1, base_id=1719219510518718000, start_id=1719219510518718000, end_id=1719219510518718001) [2024-06-24 16:58:30.519532] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E922-0-0] [lt=32] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:30.519718] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E922-0-0] [lt=30][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:30.521688] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F61-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:30.521961] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F61-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:30.522184] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F61-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:30.522410] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F61-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:30.522788] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A1F61-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:30.527532] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=19] ls blacklist refresh finish(cost_time=11985) [2024-06-24 16:58:30.528447] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D1B-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:30.531474] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D1C-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:30.533259] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13718, offset=3445136}, end_cursor:ObLogCursor{file_id=1, log_id=13719, offset=3445409}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ff8050, len:3696, log_data_len:273, seq:13718, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:30.535034] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D905-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219510534577000, start_id=1719219510534577000, end_id=1719219510534577001) [2024-06-24 16:58:30.535450] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8319) [2024-06-24 16:58:30.535506] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8319) [2024-06-24 16:58:30.535544] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=431, avg_log_submit_to_slide_time=443) [2024-06-24 16:58:30.536022] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13719, offset=3445409}, end_cursor:ObLogCursor{file_id=1, log_id=13720, offset=3445674}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c04050, len:3423, log_data_len:265, seq:13719, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:30.545615] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219510545151000, start_id=1719219510545151000, end_id=1719219510545151001) [2024-06-24 16:58:30.550581] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.553665] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-06-24 16:58:30.555608] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219510554663000, start_id=1719219510554663000, end_id=1719219510554663001) [2024-06-24 16:58:30.556413] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219510555720000, start_id=1719219510555720000, end_id=1719219510555720001) [2024-06-24 16:58:30.567211] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1003) [2024-06-24 16:58:30.567240] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=25] start lib cache evict(tenant_id=1003, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:30.567260] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1003, cache_evict_num=0, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:30.567278] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:30.573944] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=144, alloc_obj_list=[{obj_id:6, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:7, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:182, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:183, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:195, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:196, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195296}, {obj_id:199, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198764}, {obj_id:232, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197576}, {obj_id:237, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:238, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:242, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:246, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:248, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:250, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:251, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:252, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:253, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:254, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:255, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:256, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190960}, {obj_id:257, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:258, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:259, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:265, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:267, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193914}, {obj_id:268, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:269, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:270, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:271, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:273, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245001}, {obj_id:274, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238477}, {obj_id:278, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303661}, {obj_id:280, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250140}, {obj_id:282, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265464}, {obj_id:283, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260287}, {obj_id:285, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:286, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:287, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:288, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:289, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:290, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:291, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:292, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:293, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:294, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:296, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:297, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:298, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:299, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:300, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:302, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:306, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:307, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:308, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:310, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:311, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:313, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:314, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:315, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192384}, {obj_id:316, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:317, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:318, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179373}, {obj_id:319, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:320, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:321, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:322, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214835}, {obj_id:323, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257749}, {obj_id:324, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257679}, {obj_id:325, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:301211}, {obj_id:326, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:322954}, {obj_id:327, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255184}, {obj_id:328, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253823}, {obj_id:329, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:326827}, {obj_id:330, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262876}, {obj_id:331, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283304}, {obj_id:332, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296168}, {obj_id:333, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:261538}, {obj_id:334, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:285869}, {obj_id:335, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300008}, {obj_id:336, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183813}, {obj_id:337, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215145}, {obj_id:338, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252630}, {obj_id:339, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273088}, {obj_id:340, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280836}, {obj_id:341, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275631}, {obj_id:342, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:284691}, {obj_id:343, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250120}, {obj_id:344, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246226}, {obj_id:345, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247565}, {obj_id:346, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242359}, {obj_id:347, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:348, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:349, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:350, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:351, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265421}, {obj_id:352, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269241}, {obj_id:353, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270506}, {obj_id:354, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276928}, {obj_id:355, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267956}, {obj_id:356, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273080}, {obj_id:357, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280749}, {obj_id:358, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292309}, {obj_id:359, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278185}, {obj_id:360, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288460}, {obj_id:361, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288428}, {obj_id:362, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303857}, {obj_id:363, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:364, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:365, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:366, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:367, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:368, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:369, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419863}, {obj_id:371, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312858}, {obj_id:372, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417607}, {obj_id:373, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:374, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:375, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:376, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:377, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:378, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:379, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:380, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:384, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:385, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200158}, {obj_id:386, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332258}, {obj_id:387, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:388, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:434, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187881}, {obj_id:435, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269004}, {obj_id:436, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:437, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:500, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297770}, {obj_id:686, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175750}, {obj_id:687, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189803}, {obj_id:688, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465848}, {obj_id:689, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461380}, {obj_id:690, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:352652}, {obj_id:691, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:850328}, {obj_id:692, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195368}, {obj_id:693, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276678}, {obj_id:694, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:695, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272832}, {obj_id:696, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242168}]) [2024-06-24 16:58:30.574532] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=585] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:30.575148] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.577620] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D422-0-0] [lt=24] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:30.578820] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=162173, task_cnt=298, avg_time=1062) [2024-06-24 16:58:30.578852] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=31] TIMER THREAD STAT: (thread_id=162172, task_cnt=296, avg_time=2458) [2024-06-24 16:58:30.578863] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=162148, task_cnt=170, avg_time=411) [2024-06-24 16:58:30.578874] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=162331, task_cnt=60, avg_time=2) [2024-06-24 16:58:30.578881] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162308, task_cnt=60, avg_time=26) [2024-06-24 16:58:30.578891] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162150, task_cnt=20, avg_time=901) [2024-06-24 16:58:30.578898] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162516, task_cnt=20, avg_time=33) [2024-06-24 16:58:30.578904] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162151, task_cnt=12, avg_time=52) [2024-06-24 16:58:30.578914] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162833, task_cnt=1995, avg_time=14) [2024-06-24 16:58:30.578920] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162925, task_cnt=2997, avg_time=1) [2024-06-24 16:58:30.578929] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162924, task_cnt=74, avg_time=1088) [2024-06-24 16:58:30.578936] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=162836, task_cnt=120, avg_time=5) [2024-06-24 16:58:30.578945] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162855, task_cnt=60, avg_time=1) [2024-06-24 16:58:30.578952] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162950, task_cnt=60, avg_time=1994) [2024-06-24 16:58:30.578961] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162988, task_cnt=248, avg_time=5) [2024-06-24 16:58:30.578973] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=162971, task_cnt=30, avg_time=80) [2024-06-24 16:58:30.578980] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162913, task_cnt=25, avg_time=6947) [2024-06-24 16:58:30.578989] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162839, task_cnt=12, avg_time=20) [2024-06-24 16:58:30.578996] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162854, task_cnt=12, avg_time=7658) [2024-06-24 16:58:30.579005] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=162918, task_cnt=12, avg_time=1972) [2024-06-24 16:58:30.579012] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162969, task_cnt=12, avg_time=2991) [2024-06-24 16:58:30.579021] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162970, task_cnt=12, avg_time=415) [2024-06-24 16:58:30.579028] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162972, task_cnt=12, avg_time=90) [2024-06-24 16:58:30.579037] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162973, task_cnt=12, avg_time=62) [2024-06-24 16:58:30.579044] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162271, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579053] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162254, task_cnt=30, avg_time=2) [2024-06-24 16:58:30.579060] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162153, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579069] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=163189, task_cnt=60, avg_time=20) [2024-06-24 16:58:30.579075] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163195, task_cnt=59, avg_time=8017) [2024-06-24 16:58:30.579084] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162299, task_cnt=60, avg_time=443) [2024-06-24 16:58:30.579094] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162938, task_cnt=6, avg_time=247) [2024-06-24 16:58:30.579100] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163038, task_cnt=30, avg_time=595) [2024-06-24 16:58:30.579110] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162298, task_cnt=12, avg_time=7552) [2024-06-24 16:58:30.579116] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162311, task_cnt=6, avg_time=51) [2024-06-24 16:58:30.579125] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162332, task_cnt=6, avg_time=269) [2024-06-24 16:58:30.579132] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=162300, task_cnt=6, avg_time=286) [2024-06-24 16:58:30.579141] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162982, task_cnt=2, avg_time=11391) [2024-06-24 16:58:30.579148] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162983, task_cnt=2, avg_time=59) [2024-06-24 16:58:30.579157] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=162326, task_cnt=1, avg_time=18) [2024-06-24 16:58:30.579163] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163442, task_cnt=33, avg_time=3121) [2024-06-24 16:58:30.579172] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162285, task_cnt=60, avg_time=6) [2024-06-24 16:58:30.579179] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163649, task_cnt=12, avg_time=4491) [2024-06-24 16:58:30.579188] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=163714, task_cnt=1996, avg_time=11) [2024-06-24 16:58:30.579194] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163805, task_cnt=2997, avg_time=1) [2024-06-24 16:58:30.579205] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=163804, task_cnt=104, avg_time=1142) [2024-06-24 16:58:30.579211] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=825, task_cnt=1995, avg_time=11) [2024-06-24 16:58:30.579221] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=918, task_cnt=2997, avg_time=1) [2024-06-24 16:58:30.579227] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163717, task_cnt=119, avg_time=6) [2024-06-24 16:58:30.579236] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=917, task_cnt=71, avg_time=1565) [2024-06-24 16:58:30.579243] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=828, task_cnt=120, avg_time=6) [2024-06-24 16:58:30.579252] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=163738, task_cnt=60, avg_time=1) [2024-06-24 16:58:30.579258] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163830, task_cnt=60, avg_time=1933) [2024-06-24 16:58:30.579265] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=443, task_cnt=248, avg_time=4) [2024-06-24 16:58:30.579274] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=855, task_cnt=60, avg_time=2) [2024-06-24 16:58:30.579280] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=943, task_cnt=60, avg_time=1987) [2024-06-24 16:58:30.579289] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=978, task_cnt=248, avg_time=7) [2024-06-24 16:58:30.579296] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=353, task_cnt=30, avg_time=101) [2024-06-24 16:58:30.579305] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=961, task_cnt=30, avg_time=94) [2024-06-24 16:58:30.579312] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163795, task_cnt=25, avg_time=7116) [2024-06-24 16:58:30.579323] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=910, task_cnt=26, avg_time=7071) [2024-06-24 16:58:30.579329] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163720, task_cnt=12, avg_time=3206) [2024-06-24 16:58:30.579338] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=163737, task_cnt=12, avg_time=8536) [2024-06-24 16:58:30.579345] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163800, task_cnt=12, avg_time=2701) [2024-06-24 16:58:30.579354] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=343, task_cnt=12, avg_time=4231) [2024-06-24 16:58:30.579360] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=348, task_cnt=12, avg_time=516) [2024-06-24 16:58:30.579369] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=358, task_cnt=12, avg_time=100) [2024-06-24 16:58:30.579376] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=363, task_cnt=12, avg_time=77) [2024-06-24 16:58:30.579385] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=836, task_cnt=12, avg_time=10) [2024-06-24 16:58:30.579391] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=854, task_cnt=12, avg_time=6742) [2024-06-24 16:58:30.579400] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=912, task_cnt=12, avg_time=2620) [2024-06-24 16:58:30.579407] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=959, task_cnt=12, avg_time=2731) [2024-06-24 16:58:30.579416] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=960, task_cnt=12, avg_time=343) [2024-06-24 16:58:30.579422] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=963, task_cnt=12, avg_time=71) [2024-06-24 16:58:30.579429] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=962, task_cnt=12, avg_time=90) [2024-06-24 16:58:30.579438] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=163818, task_cnt=6, avg_time=321) [2024-06-24 16:58:30.579444] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=931, task_cnt=6, avg_time=236) [2024-06-24 16:58:30.579454] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=163489, task_cnt=2, avg_time=181) [2024-06-24 16:58:30.579460] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1204, task_cnt=1996, avg_time=14) [2024-06-24 16:58:30.579469] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1302, task_cnt=2997, avg_time=1) [2024-06-24 16:58:30.579476] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1301, task_cnt=104, avg_time=964) [2024-06-24 16:58:30.579485] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1092, task_cnt=6, avg_time=694) [2024-06-24 16:58:30.579491] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1462, task_cnt=1996, avg_time=11) [2024-06-24 16:58:30.579501] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1207, task_cnt=120, avg_time=8) [2024-06-24 16:58:30.579507] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1559, task_cnt=2997, avg_time=1) [2024-06-24 16:58:30.579516] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1558, task_cnt=72, avg_time=1545) [2024-06-24 16:58:30.579523] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1465, task_cnt=120, avg_time=7) [2024-06-24 16:58:30.579532] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1229, task_cnt=60, avg_time=3) [2024-06-24 16:58:30.579538] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1357, task_cnt=60, avg_time=1978) [2024-06-24 16:58:30.579549] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=1399, task_cnt=248, avg_time=5) [2024-06-24 16:58:30.579556] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=1490, task_cnt=60, avg_time=2) [2024-06-24 16:58:30.579565] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1583, task_cnt=60, avg_time=1626) [2024-06-24 16:58:30.579572] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1632, task_cnt=248, avg_time=6) [2024-06-24 16:58:30.579581] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1381, task_cnt=30, avg_time=89) [2024-06-24 16:58:30.579587] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1602, task_cnt=30, avg_time=76) [2024-06-24 16:58:30.579596] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1292, task_cnt=26, avg_time=7315) [2024-06-24 16:58:30.579603] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=408, task_cnt=2, avg_time=14590) [2024-06-24 16:58:30.579610] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=413, task_cnt=2, avg_time=81) [2024-06-24 16:58:30.579619] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1549, task_cnt=26, avg_time=6684) [2024-06-24 16:58:30.579639] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=20] TIMER THREAD STAT: (thread_id=972, task_cnt=2, avg_time=9634) [2024-06-24 16:58:30.579649] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=973, task_cnt=2, avg_time=70) [2024-06-24 16:58:30.579655] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1210, task_cnt=12, avg_time=29) [2024-06-24 16:58:30.579664] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1227, task_cnt=12, avg_time=9686) [2024-06-24 16:58:30.579671] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1297, task_cnt=12, avg_time=2709) [2024-06-24 16:58:30.579682] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=1379, task_cnt=12, avg_time=5409) [2024-06-24 16:58:30.579688] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1380, task_cnt=12, avg_time=708) [2024-06-24 16:58:30.579697] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1383, task_cnt=12, avg_time=51) [2024-06-24 16:58:30.579704] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=1382, task_cnt=12, avg_time=102) [2024-06-24 16:58:30.579713] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1468, task_cnt=12, avg_time=16) [2024-06-24 16:58:30.579720] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=1489, task_cnt=12, avg_time=7790) [2024-06-24 16:58:30.579729] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1554, task_cnt=12, avg_time=2638) [2024-06-24 16:58:30.579736] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1600, task_cnt=12, avg_time=2767) [2024-06-24 16:58:30.579744] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1601, task_cnt=12, avg_time=349) [2024-06-24 16:58:30.579751] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=1603, task_cnt=12, avg_time=88) [2024-06-24 16:58:30.579760] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1604, task_cnt=12, avg_time=72) [2024-06-24 16:58:30.579766] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1187, task_cnt=6, avg_time=1686) [2024-06-24 16:58:30.579775] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1315, task_cnt=6, avg_time=325) [2024-06-24 16:58:30.579782] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=1572, task_cnt=6, avg_time=219) [2024-06-24 16:58:30.579791] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=162276, task_cnt=1, avg_time=29) [2024-06-24 16:58:30.579799] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=163488, task_cnt=1, avg_time=14111) [2024-06-24 16:58:30.579806] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162867, task_cnt=1, avg_time=134) [2024-06-24 16:58:30.579815] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162980, task_cnt=1, avg_time=17879) [2024-06-24 16:58:30.579822] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1738, task_cnt=6, avg_time=661) [2024-06-24 16:58:30.579831] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1392, task_cnt=2, avg_time=38841) [2024-06-24 16:58:30.579838] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1393, task_cnt=2, avg_time=79) [2024-06-24 16:58:30.579847] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1615, task_cnt=2, avg_time=8650) [2024-06-24 16:58:30.579853] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1616, task_cnt=2, avg_time=67) [2024-06-24 16:58:30.579862] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=1971, task_cnt=6, avg_time=1800) [2024-06-24 16:58:30.579869] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163750, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579878] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=398, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579885] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=865, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579894] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=970, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579901] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1242, task_cnt=1, avg_time=60) [2024-06-24 16:58:30.579910] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=1390, task_cnt=1, avg_time=35561) [2024-06-24 16:58:30.579922] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=12] TIMER THREAD STAT: (thread_id=1502, task_cnt=1, avg_time=50) [2024-06-24 16:58:30.579929] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1613, task_cnt=1, avg_time=16143) [2024-06-24 16:58:30.579938] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=8] TIMER THREAD STAT: (thread_id=162309, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579944] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=162951, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579953] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=163190, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579960] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=7] TIMER THREAD STAT: (thread_id=163831, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579969] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=944, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579976] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1358, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579982] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=1584, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579991] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=9] TIMER THREAD STAT: (thread_id=162586, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.579998] INFO dump (ob_timer_monitor.cpp:200) [162332][ObTimer][T0][Y0-0000000000000000-0-0] [lt=6] TIMER THREAD STAT: (thread_id=163113, task_cnt=0, avg_time=0) [2024-06-24 16:58:30.582704] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1719219510582145000, start_id=1719219510582145000, end_id=1719219510582145001) [2024-06-24 16:58:30.582777] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:30.582812] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:30.583115] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=350, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:30.583133] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=13, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:30.583162] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:30.583186] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=410, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:30.583202] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=25, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:30.585525] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D2F-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:30.600184] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=28] ====== tenant freeze timer task ====== [2024-06-24 16:58:30.603863] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219510603257000, start_id=1719219510603257000, end_id=1719219510603257001) [2024-06-24 16:58:30.614988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283263987712, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:30.619537] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:30.620465] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:30.623906] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C355-0-0] [lt=34] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219509509397, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:30.623956] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C355-0-0] [lt=47] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219509511409, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:30.623981] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C355-0-0] [lt=24] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1719213093}, renew_time:1719219509513248, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219509513243, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:30.624014] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C355-0-0] [lt=33] [LS_LOCATION]dump tenant ls location caches(tenant_id=1003, tenant_ls_locations=[{cache_key:{tenant_id:1003, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219509514911, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:30.624037] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C355-0-0] [lt=21] [LS_LOCATION]dump tenant ls location caches(tenant_id=1004, tenant_ls_locations=[{cache_key:{tenant_id:1004, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219509516611, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}, {cache_key:{tenant_id:1004, ls_id:{id:1001}, cluster_id:1719213093}, renew_time:1719219509516615, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:30.643721] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1003, server_version={version:{val:1719219510427877000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=215837, in_cluster_service=true, cluster_version={val:1719219510344612000, v:0}, min_cluster_version={val:1719219510344612000, v:0}, max_cluster_version={val:1719219510344612000, v:0}, get_cluster_version_err=0, cluster_version_delta=299102, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59819, succ_cluster_heartbeat_count=9, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219471621660000, v:0}, local_cluster_delta=39022054, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:30.647326] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD4E-0-0] [lt=27] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:30.650651] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.661073] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=434, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:30.661095] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1635) [2024-06-24 16:58:30.661091] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1211) [2024-06-24 16:58:30.661117] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:30.661148] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:30.661169] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=509, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:30.661185] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:30.669687] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1650) [2024-06-24 16:58:30.675205] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.699462] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:30.700767] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=13] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:30.702126] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=26] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:30.702211] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=24] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506800618000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:30.703025] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1719219510423650000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=279371, in_cluster_service=true, cluster_version={val:1719219510403631000, v:0}, min_cluster_version={val:1719219510403631000, v:0}, max_cluster_version={val:1719219510403631000, v:0}, get_cluster_version_err=0, cluster_version_delta=299390, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60107, succ_cluster_heartbeat_count=10, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219444964826000, v:0}, local_cluster_delta=65738195, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:30.715080] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=81800000, replace_num=100000) [2024-06-24 16:58:30.715117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:30.718229] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:30.718903] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219510718257000, start_id=1719219510718257000, end_id=1719219510718257001) [2024-06-24 16:58:30.719996] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:30.720101] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219507115876000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:30.721047] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D438-0-0] [lt=24] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:30.722530] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=14900, mem_used=95668224) [2024-06-24 16:58:30.726232] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2030-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219510725656000, start_id=1719219510725656000, end_id=1719219510725656001) [2024-06-24 16:58:30.726329] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073A21-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219510725656000, start_id=1719219510725656001, end_id=1719219510725656002) [2024-06-24 16:58:30.726397] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041CB1-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219510725656000, start_id=1719219510725656002, end_id=1719219510725656003) [2024-06-24 16:58:30.729542] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=26] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:30.745757] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219510745688000, start_id=1719219510745688000, end_id=1719219510745688001) [2024-06-24 16:58:30.746198] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8424) [2024-06-24 16:58:30.750088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D69-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:30.750708] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.753193] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D6A-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:30.756427] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [338][T1002_TenantWea][T1001][YB42AC141156-00061B9D9031381D-0-0] [lt=16] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.605527687072753906e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=380, Throttle Trigger(MB)=228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.385500888480237336e+02) [2024-06-24 16:58:30.756544] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219510756257000, start_id=1719219510756257000, end_id=1719219510756257001) [2024-06-24 16:58:30.758948] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D6D-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:30.761228] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1757) [2024-06-24 16:58:30.761268] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=485, avg_log_submit_to_slide_time=495) [2024-06-24 16:58:30.761993] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D6E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:30.765068] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D6F-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:30.766802] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494460, support_ssl=false) [2024-06-24 16:58:30.766904] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221494460, sess.client_addr_="172.20.17.86:49496") [2024-06-24 16:58:30.766931] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f46bf5f6030, session_id:3221494460, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:30.766993] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=39][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6030, session_id:3221494460, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:30.767026] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494460, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:30.767044] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f46bf5f6030, session_id:3221494460, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:30.767068] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494460) [2024-06-24 16:58:30.767082] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162514][sql_nio24][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494460, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:30.775260] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.782853] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219510782701000, start_id=1719219510782701000, end_id=1719219510782701001) [2024-06-24 16:58:30.783389] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=262] [APPLY STAT CB APPEND COST TIME](cur_stat_count=55, stat_interval=5000000, avg (count/cost)=30, this=0x7f46f1dd4280, extra_info="") [2024-06-24 16:58:30.783418] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=55, stat_interval=5000000, avg (count/cost)=419, this=0x7f46f1dd44b0, extra_info="") [2024-06-24 16:58:30.783435] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=55, stat_interval=5000000, avg (count/cost)=0, this=0x7f46f1dd46e0, extra_info="") [2024-06-24 16:58:30.783450] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=55, stat_interval=5000000, avg (count/cost)=-490, this=0x7f46f1dd4910, extra_info="") [2024-06-24 16:58:30.783463] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=55, stat_interval=5000000, avg (count/cost)=-41, this=0x7f46f1dd4b40, extra_info="") [2024-06-24 16:58:30.791152] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D77-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:30.794116] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D78-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:30.798683] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7A-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:30.801479] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:30.801584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:30.801785] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:30.801850] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:30.802005] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:30.802078] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:30.802174] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:30.803797] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219510802779000, start_id=1719219510802779000, end_id=1719219510802779001) [2024-06-24 16:58:30.807902] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=49] BlockGCTimerTask success(ret=0, cost_time_us=9, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:30.811098] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=9] ====== check clog disk timer task ====== [2024-06-24 16:58:30.811114] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=10] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=114) [2024-06-24 16:58:30.811127] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=6] cannot_recycle_log_size statistics(cannot_recycle_log_size=53439290, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:30.811603] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=66] LogLoopThread round_cost_time(us)(round_cost_time=16) [2024-06-24 16:58:30.814390] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D7D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:30.815508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283268182016, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:30.824465] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=10] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=32, mem_used=49913856) [2024-06-24 16:58:30.824485] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=12] release old cannot free more memory [2024-06-24 16:58:30.824489] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=3] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=24, size_used=0, mem_used=49913856) [2024-06-24 16:58:30.828618] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16471, offset=3751881}, end_cursor:ObLogCursor{file_id=1, log_id=16472, offset=3752154}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ffc050, len:4151, log_data_len:273, seq:16471, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:30.829328] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F6-0-0] [lt=13][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:30.829342] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F6-0-0] [lt=13][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:30.830340] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F6-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219510830264000, start_id=1719219510830264000, end_id=1719219510830264001) [2024-06-24 16:58:30.830383] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F6-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8422, avg_group_log_size=601) [2024-06-24 16:58:30.830396] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F6-0-0] [lt=11] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8424) [2024-06-24 16:58:30.830920] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8422) [2024-06-24 16:58:30.830981] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=383, avg_log_submit_to_slide_time=394) [2024-06-24 16:58:30.831330] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219510831321000, start_id=1719219510831321000, end_id=1719219510831321001) [2024-06-24 16:58:30.831398] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=420, get_gts_with_stc_cnt=66, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:30.831442] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=8225, get_gts_with_stc_cnt=35, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=33, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:30.831518] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16472, offset=3752154}, end_cursor:ObLogCursor{file_id=1, log_id=16473, offset=3752419}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c08050, len:3878, log_data_len:265, seq:16472, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:30.836468] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=16508732, clean_num=201326) [2024-06-24 16:58:30.850758] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:30.850786] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:30.850795] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=8][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.853563] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D8C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:30.855688] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=12] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1719219510490180000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=365505, in_cluster_service=true, cluster_version={val:1719219510490180000, v:0}, min_cluster_version={val:1719219510490180000, v:0}, max_cluster_version={val:1719219510490180000, v:0}, get_cluster_version_err=0, cluster_version_delta=365505, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60034, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219385327519000, v:0}, local_cluster_delta=125528166, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:30.856384] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D8D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:30.869990] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1772) [2024-06-24 16:58:30.870029] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=379, avg_log_submit_to_slide_time=391) [2024-06-24 16:58:30.873200] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.873480] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.873646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.873810] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.873929] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874252] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874281] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874285] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874427] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874428] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874541] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874551] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874583] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874659] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874688] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874685] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874767] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874837] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874770] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.874940] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:30.875315] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.880949] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1004, server_version={version:{val:1719219510459535002, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=421406, in_cluster_service=true, cluster_version={val:1719219510459535001, v:0}, min_cluster_version={val:1719219510459535001, v:0}, max_cluster_version={val:1719219510459535001, v:0}, get_cluster_version_err=0, cluster_version_delta=421406, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59861, succ_cluster_heartbeat_count=6, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219412155330001, v:0}, local_cluster_delta=98725611, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:30.882921] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1719219510882919, bytes: 170587869, bw: 0.020359 MB/s, add_ts: 1007614, add_bytes: 21510 [2024-06-24 16:58:30.889509] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1586][T1003_LCLSender][T1003][Y0-0000000000000000-0-0] [lt=43] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47041fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:30.894156] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=37] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:30.907148] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95D9F-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:30.910996] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:30.915217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:30.919060] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219510919027000, start_id=1719219510919027000, end_id=1719219510919027001) [2024-06-24 16:58:30.936609] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [383][T1002_ArcSender][T1002][YB42AC141156-00061B9D8D10C0E5-0-0] [lt=29][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:30.944646] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219510944394000, start_id=1719219510944394000, end_id=1719219510944394001) [2024-06-24 16:58:30.950814] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=6][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.951312] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:30.956431] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219510956028000, start_id=1719219510956028000, end_id=1719219510956028001) [2024-06-24 16:58:30.960885] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:30.960937] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1635, avg_group_log_size=163) [2024-06-24 16:58:30.960966] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1635) [2024-06-24 16:58:30.960989] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:30.961025] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:30.961055] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1211) [2024-06-24 16:58:30.961323] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=440, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:30.975374] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:30.983032] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=61] get number(ret=0, service_type_=0, range=1, base_id=1719219510982448000, start_id=1719219510982448000, end_id=1719219510982448001) [2024-06-24 16:58:30.983611] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=29] get_max_applied_scn(scn={val:1719219510831321000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:57966451}, palf_committed_end_scn_:{val:1719219510831321001, v:0}, last_check_scn_:{val:1719219510831321001, v:0}, max_applied_cb_scn_:{val:1719219510831321000, v:0}}) [2024-06-24 16:58:30.983663] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=50] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213369678630001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:31.000283] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:31.000343] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=32] get_max_applied_scn(scn={val:1719219510919027000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:53439997}, palf_committed_end_scn_:{val:1719219510919027000, v:0}, last_check_scn_:{val:1719219510919027000, v:0}, max_applied_cb_scn_:{val:1719219510919027000, v:0}}) [2024-06-24 16:58:31.000383] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:31.002325] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=100] gc stale ls task succ [2024-06-24 16:58:31.002783] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=113] succ to get rec scn(*this={this:0x7f47b3e04030, ls_id:{id:1}, tenant_id:1, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216858758544000, v:0}, last_push_gc_task_ts_:1719216859472314, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1025}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.002822] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47b6924080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216859475873, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47b6924080, snapshot_version:{val:1719216859475873, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.002873] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:31.003083] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219518711542000, latest_log_ts:{val:1719219502113333001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:31.003200] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=112] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f47b684c1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f47b685a0d0, memtable_head:3, memtable_tail:4, t3m:0x7f47ded72030, tables:[null, null, null, 0x7f47b6914080, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215058499657, tx_data_table:0x7f47b685bb90, ls_tablet_svr:0x7f47b684c190}, min_rec_scn={val:1719216859633263000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:31.003252] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:31.003275] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219502113333001, v:0}) [2024-06-24 16:58:31.003289] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.003306] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.003326] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216859633263000, v:0}, checkpoint_scn_in_ls_meta={val:1719216859633263000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:31.003355] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:31.003379] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:31.003396] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:31.003907] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219511003544000, start_id=1719219511003544000, end_id=1719219511003544001) [2024-06-24 16:58:31.024684] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 398.50) [2024-06-24 16:58:31.024721] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:31.024821] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 448.50) [2024-06-24 16:58:31.024838] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:31.024876] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024899] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024915] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024934] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024947] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024961] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024977] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.024993] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025021] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025037] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025051] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025067] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025085] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025098] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.025111] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:31.034965] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:31.034998] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:31.035035] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=348722867, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:31.035115] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] tx gc loop thread is running(MTL_ID()=1) [2024-06-24 16:58:31.035139] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] try gc retain ctx [2024-06-24 16:58:31.037430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283263987712, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:31.037407] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=13] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219518711542000, latest_log_ts:{val:1719219502113333001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:31.050875] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.053453] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:31.055812] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=13] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213342229334001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:31.069563] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:31.069601] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:31.069650] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:31.069692] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:31.069975] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=345, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:31.070007] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:31.070039] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:31.070068] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=420, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:31.070088] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:31.070230] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=373, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:31.070270] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=17, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:31.070289] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:31.070306] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=469, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:31.070320] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=26, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:31.074838] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DDF-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:31.075432] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.077920] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DE0-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:31.083566] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DE2-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:31.085646] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C76DE-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:31.088684] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DE4-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:31.094328] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=364, mem_used=2079744) [2024-06-24 16:58:31.095919] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096321] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096323] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096555] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096677] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096916] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096923] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096923] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.096928] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097047] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097329] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097343] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097683] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097695] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097696] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097697] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097710] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097735] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097804] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097907] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097905] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.097910] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098026] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098099] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098099] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098093] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098134] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098142] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098516] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098604] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=70] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098662] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098709] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.098941] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.099647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.113612] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DEC-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:31.115320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:31.116825] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DED-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:31.119315] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219511118746000, start_id=1719219511118746000, end_id=1719219511118746001) [2024-06-24 16:58:31.119876] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3947) [2024-06-24 16:58:31.119929] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=418, avg_log_submit_to_slide_time=434) [2024-06-24 16:58:31.120019] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=8] [APPLY STAT CB APPEND COST TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=35, this=0x7f47b68f8280, extra_info="") [2024-06-24 16:58:31.120055] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=34] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=453, this=0x7f47b68f84b0, extra_info="") [2024-06-24 16:58:31.120073] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=0, this=0x7f47b68f86e0, extra_info="") [2024-06-24 16:58:31.120094] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=21] [APPLY STAT CB EXECUTE TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=-481, this=0x7f47b68f8910, extra_info="") [2024-06-24 16:58:31.120110] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=15] [APPLY STAT CB TOTAL TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=6, this=0x7f47b68f8b40, extra_info="") [2024-06-24 16:58:31.122438] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DEF-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:31.125351] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:31.125466] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:31.125691] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:31.125761] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:31.125931] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:31.126010] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:31.126117] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF1-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:31.133002] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=31] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:31.136374] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D3-0-0] [lt=15] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:31.136407] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D3-0-0] [lt=30] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:31.136640] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EE-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:31.136674] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EE-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:31.142141] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DF2-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:31.144746] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219511144113000, start_id=1719219511144113000, end_id=1719219511144113001) [2024-06-24 16:58:31.150943] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.156565] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1719219511155738000, start_id=1719219511155738000, end_id=1719219511155738001) [2024-06-24 16:58:31.161424] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:31.161450] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:31.161467] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=430, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:31.161482] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=27, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:31.169656] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1644, avg_group_log_size=164) [2024-06-24 16:58:31.169694] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1644) [2024-06-24 16:58:31.169732] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=5164, avg_group_log_size=430) [2024-06-24 16:58:31.169752] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=5164) [2024-06-24 16:58:31.174539] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=25] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:31.175518] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:31.175536] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:31.175548] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.175795] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1187][T1002_TTLTablet][T1002][YB42AC141156-00061B9D9740C34C-0-0] [lt=31] finish reload tenant task(local_tenant_task_={tenant_id:1002, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:31.181832] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=110] get number(ret=0, service_type_=0, range=1, base_id=1719219511181103000, start_id=1719219511181103000, end_id=1719219511181103001) [2024-06-24 16:58:31.182275] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95DFF-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:31.185352] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E00-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:31.197657] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D89F-0-0] [lt=39][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:31.201051] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:31.205355] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:31.205400] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:31.205418] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] submit log success(service_type_=0, last_id=1719219527830421000, limited_id=1719219527830421000) [2024-06-24 16:58:31.205440] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] submit log with lock success(service_type_=0, last_id=1719219527830421000, limited_id=1719219527830421000) [2024-06-24 16:58:31.205457] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219511204349000, start_id=1719219511204349000, end_id=1719219511204349001) [2024-06-24 16:58:31.205875] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1719219527830421000, latest_scn={val:1719219511204349001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:31.205911] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=35] handle submit callback(service_type_=0, success=true, used_ts=493, log_ts={val:1719219511204349001, v:0}, limited_id=1719219527830421000) [2024-06-24 16:58:31.205918] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=7] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:31.205950] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=32] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:31.206201] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=10] get number(ret=0, service_type_=0, range=1, base_id=1719219511205407000, start_id=1719219511205407000, end_id=1719219511205407001) [2024-06-24 16:58:31.206308] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:31.230144] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict mem start(request_manager_->get_tenant_id()=1, evict_low_mem_level=328564998, evict_high_mem_level=438086664, size_used=211550, mem_used=438825984) [2024-06-24 16:58:31.235253] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=109] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:31.235285] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3947, avg_group_log_size=394) [2024-06-24 16:58:31.235307] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3947) [2024-06-24 16:58:31.235324] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:31.235641] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3947) [2024-06-24 16:58:31.235708] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:31.235737] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=443, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:31.235756] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:31.236671] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [967][T1001_ArcSender][T1001][YB42AC141156-00061B9D8DB0C0E5-0-0] [lt=29][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:31.237995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283272376320, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:31.239674] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E11-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:31.250997] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=33][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.275545] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=6][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.285268] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:103369, max_lsn:517614737, max_scn:{val:1719219510831321004, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:517614737}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:475671697}}, last_submit_lsn:{lsn:517614615}, last_submit_end_lsn:{lsn:517614737}, last_submit_log_id:103369, last_submit_log_pid:1, max_flushed_lsn:{lsn:517614615}, max_flushed_end_lsn:{lsn:517614737}, max_flushed_log_pid:1, committed_end_lsn:{lsn:517614737}, last_slide_log_id:103369, last_slide_scn:{val:1719219510831321004, v:0}, last_slide_lsn:{lsn:517614615}, last_slide_end_lsn:{lsn:517614737}, last_slide_log_pid:1, last_slide_log_accum_checksum:4039713631, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4736730530}, [StateMgr]={this:0x7f47367342b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:103370, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213349729967, palf_role_change_cb:0x7f473673acb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4736731c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213342229334002, v:0}, base_lsn_for_block_gc:{lsn:201314304}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:201314304}, prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}}, log_meta_storage:{log_tail:{lsn:24576}, readable_log_tail:{lsn:24576}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:536838144}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1001/meta", dir_fd:674, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67080192, block_header_serialize_buf_:0x7f4736736478, flashback_version:0}, log_storage:{log_tail:{lsn:517614737}, readable_log_tail:{lsn:517614737}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:469733376}, min_scn:{val:1719215616323502002, v:0}, curr_block_id:7, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1001/log", dir_fd:675, min_block_id:0, max_block_id:8, curr_writable_block_id:7}, logical_block_size_:67104768, curr_block_writable_size_:19223407, block_header_serialize_buf_:0x7f4736738138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213349730110, this:0x7f47367349f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213349730486, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4736734430}) [2024-06-24 16:58:31.285649] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=375] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219511270072, last_flushed_end_lsn:{lsn:517614737}}]) [2024-06-24 16:58:31.285682] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=29] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=103370, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219511270072, last_flushed_end_lsn:{lsn:517614737}}]) [2024-06-24 16:58:31.288208] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:31.288337] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=60] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:31.288368] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:31.288444] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1602379776, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5913812992, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:31.288559] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:31.288584] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=416085, drift_size_=0, pre_drift_size=30600560, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=145041, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:31.288663] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:31.288748] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=28] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:31.288767] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:31.288835] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=24] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:31.288965] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:31.288990] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:31.295346] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=37] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:31.300298] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:31.300325] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=130) [2024-06-24 16:58:31.300357] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=70237971, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:31.302863] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:31.303582] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] succ to get rec scn(*this={this:0x7f474be04030, ls_id:{id:1}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215719054755000, v:0}, last_push_gc_task_ts_:1719216936767864, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.303601] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739404080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216936773978, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739404080, snapshot_version:{val:1719216936773978, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.303633] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:31.303690] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219508389231000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:31.303743] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=51] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f4753c761b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f4753c840d0, memtable_head:2, memtable_tail:3, t3m:0x7f4782d1e030, tables:[null, null, 0x7f4753dced90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215135780086, tx_data_table:0x7f4753c85b90, ls_tablet_svr:0x7f4753c76190}, min_rec_scn={val:1719216939041208000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:31.303768] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:31.303778] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=8] get rec log scn(service_type_=0, rec_log_ts={val:1719219509829313001, v:0}) [2024-06-24 16:58:31.303784] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=6] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.303794] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=3] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216939041208000, v:0}, checkpoint_scn_in_ls_meta={val:1719216939041208000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:31.303811] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:31.303823] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:31.304537] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] succ to get rec scn(*this={this:0x7f474beb6030, ls_id:{id:1001}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213748817809002, v:0}, last_push_gc_task_ts_:1719215150704743, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:580}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.304550] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739405350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215150709832, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739405350, snapshot_version:{val:1719215150709832, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:31.304561] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=9] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:31.304586] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=9] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219508389231000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:31.304631] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=43] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f4736709790}, min_rec_scn={val:1719215150797158000, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:31.304638] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=5] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213342229334001, v:0}) [2024-06-24 16:58:31.304646] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=5] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215150797158000, v:0}, checkpoint_scn_in_ls_meta={val:1719215150797158000, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:31.304653] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=5][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:201314304}, new_base_lsn={lsn:201314304}, lsn={lsn:201314304}) [2024-06-24 16:58:31.304661] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=8] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:201314304}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:31.304665] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=4] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:31.315410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:31.319227] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219511318617000, start_id=1719219511318617000, end_id=1719219511318617001) [2024-06-24 16:58:31.321209] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=11] ====== tenant freeze timer task ====== [2024-06-24 16:58:31.322962] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [1355][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1004, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:31.323082] WDIAG read_multi_row (ob_table_access_helper.h:238) [1355][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=38][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1004, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:31.323261] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:221) [1355][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=21] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:31.325017] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=2, elapse_time=94873, size_used=111553, mem_used=262047744) [2024-06-24 16:58:31.325323] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [1371][T1004_ObXAHbWor][T1004][Y0-0000000000000000-0-0] [lt=30] XA scheduler heartbeat task statistics(avg_time=3) [2024-06-24 16:58:31.332108] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A22E0-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219511331262000, start_id=1719219511331262000, end_id=1719219511331262001) [2024-06-24 16:58:31.332253] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219511331262000, start_id=1719219511331262000, end_id=1719219511331262001) [2024-06-24 16:58:31.332262] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD78F-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219511331262000, start_id=1719219511331262001, end_id=1719219511331262002) [2024-06-24 16:58:31.332306] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:31.334786] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=24] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:31.334914] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=127] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:31.334935] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:31.335013] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=78] get_replay_process success(id={id:1001}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:31.335078] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=15] dump tenant replay process(tenant_id=1004, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:31.341736] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:31.342340] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:231) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=13] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"8GB", log_disk_size:"24GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}, {unit:unit_id:1002, resource_pool_id:1002, unit_group_id:1002, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"16GB", log_disk_size:"48GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1002, name:"ocp_monitor_pool", unit_count:1, unit_config_id:1002, zone_list:["zone1"], tenant_id:1004, replica_type:0}}]) [2024-06-24 16:58:31.342452] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:810) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=104] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2024-06-24 16:58:31.342474] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:705) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=19] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, user_resource={min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, unit_resource={min_cpu:4, max_cpu:4, memory_size:"8GB", log_disk_size:"24GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}) [2024-06-24 16:58:31.342513] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:125) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=36] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}) [2024-06-24 16:58:31.342559] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:810) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=43] jx_debug: get tenant compatibility mode(tenant_id=1004, compat_mode=0) [2024-06-24 16:58:31.342573] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:705) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=13] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, user_resource={min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, unit_resource={min_cpu:4, max_cpu:4, memory_size:"16GB", log_disk_size:"48GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}) [2024-06-24 16:58:31.342599] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:125) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=25] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}, user_config={tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}) [2024-06-24 16:58:31.344837] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219511343945000, start_id=1719219511343945000, end_id=1719219511343945001) [2024-06-24 16:58:31.346510] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=44] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2024-06-24 16:58:31.348574] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=30] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2024-06-24 16:58:31.350571] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=34] refresh_resource_function_mapping_rule(tenant_id=1, plan=, rules=[]) [2024-06-24 16:58:31.350602] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=30] refresh resource mapping rule success(tenant_id=1, plan=) [2024-06-24 16:58:31.351052] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.352549] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C354-0-0] [lt=33] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:31.352731] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C354-0-0] [lt=27] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:31.352752] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C354-0-0] [lt=18] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:31.356271] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=23] refresh resource plan success(tenant_id=1001, plan_name=, directives=[]) [2024-06-24 16:58:31.357957] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219511357688000, start_id=1719219511357688000, end_id=1719219511357688001) [2024-06-24 16:58:31.358166] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2024-06-24 16:58:31.358571] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219510831321002, v:0}, new_max_version={val:1719219510831321002, v:0}, last_min_version={val:1719219510831321000, v:0}, last_max_version={val:1719219510831321000, v:0}, total_time_us=2611, delta_us=527248) [2024-06-24 16:58:31.358607] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219510831321002, v:0}, min_version={val:1719219510831321002, v:0}, max_version={val:1719219510831321002, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:31.360031] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=28] refresh_resource_function_mapping_rule(tenant_id=1001, plan=, rules=[]) [2024-06-24 16:58:31.360060] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=28] refresh resource mapping rule success(tenant_id=1001, plan=) [2024-06-24 16:58:31.361178] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=38] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:31.361211] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:31.361828] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C354-0-0] [lt=16] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2024-06-24 16:58:31.362012] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:31.362035] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C354-0-0] [lt=21] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:31.365647] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=20] refresh resource plan success(tenant_id=1002, plan_name=, directives=[]) [2024-06-24 16:58:31.367728] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2024-06-24 16:58:31.369594] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] refresh_resource_function_mapping_rule(tenant_id=1002, plan=, rules=[]) [2024-06-24 16:58:31.369635] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1002, plan=) [2024-06-24 16:58:31.371429] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C354-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:31.371613] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C354-0-0] [lt=25] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:31.371664] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C354-0-0] [lt=49] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:31.375600] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.376508] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C354-0-0] [lt=20][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1690, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:31.378345] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] refresh resource plan success(tenant_id=1003, plan_name=, directives=[]) [2024-06-24 16:58:31.380116] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] refresh resource user mapping rule(tenant_id=1003, plan=, user_rules=[]) [2024-06-24 16:58:31.381811] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=24] refresh_resource_function_mapping_rule(tenant_id=1003, plan=, rules=[]) [2024-06-24 16:58:31.381841] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=29] refresh resource mapping rule success(tenant_id=1003, plan=) [2024-06-24 16:58:31.382008] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219511382001000, start_id=1719219511382001000, end_id=1719219511382001001) [2024-06-24 16:58:31.383428] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C354-0-0] [lt=12] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2024-06-24 16:58:31.383598] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C354-0-0] [lt=23] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:31.383617] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C354-0-0] [lt=17] tenant dfc status(ret=0, get_tenant_id()=1003, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:31.386924] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=42] refresh resource plan success(tenant_id=1004, plan_name=, directives=[]) [2024-06-24 16:58:31.388711] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=24] refresh resource user mapping rule(tenant_id=1004, plan=, user_rules=[]) [2024-06-24 16:58:31.390410] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=25] refresh_resource_function_mapping_rule(tenant_id=1004, plan=, rules=[]) [2024-06-24 16:58:31.390438] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=27] refresh resource mapping rule success(tenant_id=1004, plan=) [2024-06-24 16:58:31.392214] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C354-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:31.392376] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C354-0-0] [lt=23] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:31.392393] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C354-0-0] [lt=15] tenant dfc status(ret=0, get_tenant_id()=1004, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:31.392426] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:108) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=17] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, {tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, {tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}], ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:31.392502] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=66] finish set nway(tenant_id_=1, nway=4) [2024-06-24 16:58:31.392518] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=15] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=4, new_tma_limit=1073741800, pre_tma_limit=1073741800, cur_memstore_limit_percent=50, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}) [2024-06-24 16:58:31.392547] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.740799999237060547e+03, this=0x7f47dedb4170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=8703, Resource Limit(MB)=8703, Throttle Trigger(MB)=5222, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=3.132550312791559585e-03) [2024-06-24 16:58:31.392572] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C354-0-0] [lt=24] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2024-06-24 16:58:31.392592] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=10] finish set nway(tenant_id_=1002, nway=4) [2024-06-24 16:58:31.392602] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=4, new_tma_limit=4509715620, pre_tma_limit=4509715620, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}) [2024-06-24 16:58:31.392636] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C354-0-0] [lt=31] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=5.734399948120117188e+02, this=0x7f4782dd6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2867, Resource Limit(MB)=2867, Throttle Trigger(MB)=1720, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=2.654160334594075632e-01) [2024-06-24 16:58:31.392654] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C354-0-0] [lt=18] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2024-06-24 16:58:31.392665] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=6] finish set nway(tenant_id_=1001, nway=1) [2024-06-24 16:58:31.392673] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=7] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}) [2024-06-24 16:58:31.392696] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C354-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f4764fea170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2024-06-24 16:58:31.392715] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C354-0-0] [lt=19] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2024-06-24 16:58:31.392728] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=9] finish set nway(tenant_id_=1004, nway=4) [2024-06-24 16:58:31.392737] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1004, nway=4, new_tma_limit=7730941100, pre_tma_limit=7730941100, cur_memstore_limit_percent=50, tenant_config={tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}) [2024-06-24 16:58:31.392758] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C354-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.474559993743896484e+03, this=0x7f47285d6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=7372, Resource Limit(MB)=7372, Throttle Trigger(MB)=4423, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.083503486695933209e-03) [2024-06-24 16:58:31.392776] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C354-0-0] [lt=17] succ to set_memstore_threshold of memstore allocator(tenant_id=1004, ret=0) [2024-06-24 16:58:31.392789] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=9] finish set nway(tenant_id_=1003, nway=1) [2024-06-24 16:58:31.392798] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1003, nway=1, new_tma_limit=1030792140, pre_tma_limit=1030792140, cur_memstore_limit_percent=40, tenant_config={tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}) [2024-06-24 16:58:31.392820] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C354-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.310719985961914062e+02, this=0x7f4703dde170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=655, Resource Limit(MB)=655, Throttle Trigger(MB)=393, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=9.610614047311770491e+01) [2024-06-24 16:58:31.392839] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C354-0-0] [lt=18] succ to set_memstore_threshold of memstore allocator(tenant_id=1003, ret=0) [2024-06-24 16:58:31.394259] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=8] cal_all_part_disk_default_percentage succ(data_dir="/data/1/sstable", clog_dir="/data/1/clog", shared_mode=true, data_disk_total_size=2396821651456, data_disk_default_percentage=60, clog_disk_total_size=2396821651456, clog_disk_default_percentage=30) [2024-06-24 16:58:31.394287] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=26] decide disk size finished(suggested_disk_size=804232626176, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2396821651456, disk_size=804232626176) [2024-06-24 16:58:31.394305] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=17] get_log_disk_info_in_config(suggested_data_disk_size=890131972096, suggested_clog_disk_size=804232626176, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=804232626176, log_disk_percentage=0, total_log_disk_size=2396821651456) [2024-06-24 16:58:31.394323] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:785) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=14] try_resize success(ret=0, log_disk_size=804232626176, total_log_disk_size=2396821651456, this={dir::"/data/1/clog/log_pool", dir_fd:14, meta_fd:15, log_pool_meta:{curr_total_size:804232626176, next_total_size:804232626176, status:0}, min_block_id:23, max_block_id:11984, min_log_disk_size_for_all_tenants_:95563022336, is_inited:true}) [2024-06-24 16:58:31.394346] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:132) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C354-0-0] [lt=21] refresh tenant config(tenants=[1, 1001, 1002, 1003, 1004], ret=0) [2024-06-24 16:58:31.405477] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219511405253000, start_id=1719219511405253000, end_id=1719219511405253001) [2024-06-24 16:58:31.405960] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=377, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:31.405996] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=12, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:31.406019] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:31.406047] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=457, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:31.406068] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=25, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:31.413770] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E4D-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:31.416926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E4F-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:31.419385] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129630, mem_used=326519808) [2024-06-24 16:58:31.422750] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E51-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:31.425107] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=11] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:31.425137] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=13] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1232) [2024-06-24 16:58:31.425825] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E52-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:31.429038] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E53-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:31.435805] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=377, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:31.435837] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:31.438533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283435954176, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:31.451107] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.454170] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E5C-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:31.456022] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C7A0D-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:31.460635] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E5E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:31.461669] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:31.461702] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=9] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=393, avg_log_submit_to_slide_time=403) [2024-06-24 16:58:31.463477] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:31.463591] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:31.463797] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:31.463860] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:31.464020] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:31.464092] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:31.464189] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E60-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:31.470149] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7218) [2024-06-24 16:58:31.470191] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=7218) [2024-06-24 16:58:31.470228] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=36, avg_log_gen_to_submit_time=44, avg_log_submit_to_flush_time=412, avg_log_submit_to_slide_time=423) [2024-06-24 16:58:31.475655] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=115][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.476477] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E61-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:31.476531] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073A3D-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219511476027000, start_id=1719219511476027000, end_id=1719219511476027001) [2024-06-24 16:58:31.479841] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:31.485787] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [162824][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=34] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:31.488864] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C7A6A-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219511488721000, start_id=1719219511488721000, end_id=1719219511488721001) [2024-06-24 16:58:31.491361] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163134][T1_L0_G0][T1][YB42AC141156-00061B9D8C20C114-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103407582721, cache_obj->added_lc()=false, cache_obj->get_object_id()=9351, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:31.515368] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=8] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2024-06-24 16:58:31.515400] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=28] start lib cache evict(tenant_id=1002, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:31.515417] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=15] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:31.515434] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:31.515501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:31.516341] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E6E-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:31.518806] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219511518318000, start_id=1719219511518318000, end_id=1719219511518318001) [2024-06-24 16:58:31.519379] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E6F-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4804, pos=2778, bitmap=NULL) [2024-06-24 16:58:31.520193] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1719219511520190, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-06-24 16:58:31.521424] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=11] Dumping All Cache Objs(alloc_obj_list.count()=753, alloc_obj_list=[{obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:206, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:208, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:213, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:215, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:218, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:219, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:221, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:222, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:223, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:224, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:225, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:226, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:227, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:230, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:258, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:259, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207636}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157087}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:262, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417132}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:293, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:297, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178532}, {obj_id:299, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174372}, {obj_id:311, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:312, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:313, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:314, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:315, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:316, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:317, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:318, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:319, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:320, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:370, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:371, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:372, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:373, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:374, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:375, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:376, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:377, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:378, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:394, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217236}, {obj_id:404, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:405, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:431, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200789}, {obj_id:787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:1554, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174647}, {obj_id:1765, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196131}, {obj_id:1767, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180746}, {obj_id:1768, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180053}, {obj_id:1769, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156392}, {obj_id:1770, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185682}, {obj_id:1771, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178754}, {obj_id:1772, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217927}, {obj_id:1773, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182452}, {obj_id:1774, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157145}, {obj_id:1775, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193250}, {obj_id:1776, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156261}, {obj_id:1777, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202011}, {obj_id:1778, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176126}, {obj_id:1779, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:1780, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179533}, {obj_id:1782, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194286}, {obj_id:1783, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191084}, {obj_id:1784, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185716}, {obj_id:1785, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197901}, {obj_id:1786, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203431}, {obj_id:1787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177702}, {obj_id:1788, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197376}, {obj_id:1789, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194100}, {obj_id:1790, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229422}, {obj_id:1791, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342799}, {obj_id:1792, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177856}, {obj_id:1793, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:1794, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:1801, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197017}, {obj_id:1802, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197375}, {obj_id:1803, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192944}, {obj_id:1804, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210981}, {obj_id:1807, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1808, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191543}, {obj_id:1809, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190396}, {obj_id:1810, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179961}, {obj_id:1811, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187508}, {obj_id:1812, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190770}, {obj_id:1814, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174667}, {obj_id:1817, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186991}, {obj_id:1820, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181584}, {obj_id:1822, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201206}, {obj_id:1823, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187930}, {obj_id:1824, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182810}, {obj_id:1826, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205149}, {obj_id:1828, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181586}, {obj_id:1830, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184827}, {obj_id:1832, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173928}, {obj_id:1833, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241466}, {obj_id:1834, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173654}, {obj_id:1835, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174122}, {obj_id:1841, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183277}, {obj_id:1842, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202767}, {obj_id:1843, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184717}, {obj_id:1844, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179338}, {obj_id:1845, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192322}, {obj_id:1846, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186117}, {obj_id:1847, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:243066}, {obj_id:1850, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203203}, {obj_id:1851, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206987}, {obj_id:1854, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202239}, {obj_id:1857, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179623}, {obj_id:1858, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199630}, {obj_id:1859, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181089}, {obj_id:1860, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191144}, {obj_id:1861, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208300}, {obj_id:1862, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207006}, {obj_id:1864, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174459}, {obj_id:1865, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197772}, {obj_id:1866, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195985}, {obj_id:1867, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187545}, {obj_id:1868, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200975}, {obj_id:1869, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190129}, {obj_id:1870, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187648}, {obj_id:1871, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180383}, {obj_id:1872, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176694}, {obj_id:1873, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199714}, {obj_id:1874, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197401}, {obj_id:1875, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211269}, {obj_id:1878, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197823}, {obj_id:1879, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180556}, {obj_id:1880, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186838}, {obj_id:1881, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173640}, {obj_id:1882, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189084}, {obj_id:1883, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182778}, {obj_id:1884, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198543}, {obj_id:1885, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184808}, {obj_id:1886, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192715}, {obj_id:1887, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178511}, {obj_id:1889, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:1890, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190883}, {obj_id:1892, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204317}, {obj_id:1895, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200704}, {obj_id:1897, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180059}, {obj_id:1898, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189670}, {obj_id:1899, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297520}, {obj_id:1900, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180210}, {obj_id:1901, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173929}, {obj_id:1902, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207174}, {obj_id:1904, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180315}, {obj_id:1905, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175944}, {obj_id:1906, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191394}, {obj_id:1907, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205016}, {obj_id:1908, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205015}, {obj_id:1909, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205042}, {obj_id:1910, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183144}, {obj_id:1912, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156278}, {obj_id:1914, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201207}, {obj_id:1915, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205705}, {obj_id:1916, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179043}, {obj_id:1918, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210554}, {obj_id:1919, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211414}, {obj_id:1920, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203461}, {obj_id:1922, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179984}, {obj_id:1924, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194777}, {obj_id:1926, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212517}, {obj_id:1927, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185341}, {obj_id:1928, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211233}, {obj_id:1929, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180552}, {obj_id:1930, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199580}, {obj_id:1932, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200277}, {obj_id:1933, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202039}, {obj_id:1935, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202217}, {obj_id:1938, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:1939, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185428}, {obj_id:1940, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342648}, {obj_id:1941, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184408}, {obj_id:1942, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188029}, {obj_id:1943, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220581}, {obj_id:1944, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186138}, {obj_id:1945, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188109}, {obj_id:1946, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184071}, {obj_id:1947, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297497}, {obj_id:1948, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259587}, {obj_id:1949, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234741}, {obj_id:1950, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230127}, {obj_id:1951, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:1952, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199425}, {obj_id:1953, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204260}, {obj_id:1955, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186747}, {obj_id:1956, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186410}, {obj_id:1957, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180371}, {obj_id:1959, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186746}, {obj_id:1960, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:314579}, {obj_id:1961, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316276}, {obj_id:1962, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179253}, {obj_id:1963, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198957}, {obj_id:1964, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253315}, {obj_id:1965, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194531}, {obj_id:1966, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181919}, {obj_id:1968, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204268}, {obj_id:1969, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:1970, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156216}, {obj_id:1971, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:1973, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206972}, {obj_id:1974, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372622}, {obj_id:1975, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:1976, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:1977, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255312}, {obj_id:1978, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255070}, {obj_id:1979, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281856}, {obj_id:1980, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312870}, {obj_id:1982, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:1983, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210959}, {obj_id:1984, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:1986, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216413}, {obj_id:1987, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:1988, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207457}, {obj_id:1989, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197063}, {obj_id:1990, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202377}, {obj_id:1991, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319848}, {obj_id:1993, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177048}, {obj_id:1994, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179527}, {obj_id:1996, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:390465}, {obj_id:1997, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181650}, {obj_id:1998, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180128}, {obj_id:1999, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175288}, {obj_id:2000, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179784}, {obj_id:2001, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183026}, {obj_id:2002, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179032}, {obj_id:2003, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186850}, {obj_id:2004, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207791}, {obj_id:2005, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188599}, {obj_id:2006, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241706}, {obj_id:2007, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179781}, {obj_id:2008, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189180}, {obj_id:2010, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175346}, {obj_id:2011, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182950}, {obj_id:2012, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178932}, {obj_id:2013, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184319}, {obj_id:2014, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182003}, {obj_id:2015, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:383980}, {obj_id:2016, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175770}, {obj_id:2017, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180015}, {obj_id:2018, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219419}, {obj_id:2019, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204596}, {obj_id:2020, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181397}, {obj_id:2021, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179054}, {obj_id:2022, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156256}, {obj_id:2023, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237344}, {obj_id:2024, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209999}, {obj_id:2025, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230256}, {obj_id:2026, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188496}, {obj_id:2027, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179278}, {obj_id:2028, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192304}, {obj_id:2029, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195605}, {obj_id:2030, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183563}, {obj_id:2031, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182637}, {obj_id:2033, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:392174}, {obj_id:2035, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304600}, {obj_id:2037, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184788}, {obj_id:2038, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185565}, {obj_id:2039, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181321}, {obj_id:2040, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204506}, {obj_id:2041, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:348902}, {obj_id:2042, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222494}, {obj_id:2043, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220331}, {obj_id:2044, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181427}, {obj_id:2045, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226680}, {obj_id:2046, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192432}, {obj_id:2047, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225643}, {obj_id:2048, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174740}, {obj_id:2049, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215812}, {obj_id:2050, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196675}, {obj_id:2051, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179861}, {obj_id:2052, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204953}, {obj_id:2053, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196998}, {obj_id:2054, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179552}, {obj_id:2055, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197192}, {obj_id:2056, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187268}, {obj_id:2057, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185914}, {obj_id:2058, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205463}, {obj_id:2059, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:391976}, {obj_id:2060, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202155}, {obj_id:2061, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207183}, {obj_id:2062, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228354}, {obj_id:2063, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240497}, {obj_id:2064, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182911}, {obj_id:2065, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218028}, {obj_id:2066, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210463}, {obj_id:2067, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176755}, {obj_id:2068, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2069, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198027}, {obj_id:2070, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181248}, {obj_id:2071, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179856}, {obj_id:2072, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185425}, {obj_id:2073, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:365208}, {obj_id:2074, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189692}, {obj_id:2075, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183454}, {obj_id:2076, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238844}, {obj_id:2077, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321800}, {obj_id:2078, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186250}, {obj_id:2079, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196079}, {obj_id:2080, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332305}, {obj_id:2081, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320208}, {obj_id:2082, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251367}, {obj_id:2083, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182508}, {obj_id:2084, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300805}, {obj_id:2085, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178980}, {obj_id:2086, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178916}, {obj_id:2087, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209270}, {obj_id:2088, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184260}, {obj_id:2089, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183375}, {obj_id:2090, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240830}, {obj_id:2091, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201771}, {obj_id:2092, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192848}, {obj_id:2093, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185409}, {obj_id:2094, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185960}, {obj_id:2095, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178833}, {obj_id:2096, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184221}, {obj_id:2098, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186713}, {obj_id:2099, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215730}, {obj_id:2101, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197347}, {obj_id:2102, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193779}, {obj_id:2103, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234706}, {obj_id:2104, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179916}, {obj_id:2105, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204599}, {obj_id:2106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208576}, {obj_id:2107, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196385}, {obj_id:2108, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2109, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2110, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181778}, {obj_id:2114, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210988}, {obj_id:2115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209186}, {obj_id:2116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197363}, {obj_id:2117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223906}, {obj_id:2118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201491}, {obj_id:2119, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292238}, {obj_id:2120, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207205}, {obj_id:2122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226896}, {obj_id:2123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181523}, {obj_id:2124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213117}, {obj_id:2125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:2126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179447}, {obj_id:2127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183182}, {obj_id:2128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184816}, {obj_id:2129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200736}, {obj_id:2130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224430}, {obj_id:2132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207161}, {obj_id:2133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192675}, {obj_id:2135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385804}, {obj_id:2137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230239}, {obj_id:2153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202184}, {obj_id:2156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205408}, {obj_id:2157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206436}, {obj_id:2158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174583}, {obj_id:2162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213869}, {obj_id:2163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195408}, {obj_id:2164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203912}, {obj_id:2166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182577}, {obj_id:2167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181498}, {obj_id:2168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199791}, {obj_id:2169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184951}, {obj_id:2170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265434}, {obj_id:2171, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186761}, {obj_id:2172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180107}, {obj_id:2173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205227}, {obj_id:2174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210318}, {obj_id:2175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196533}, {obj_id:2176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180448}, {obj_id:2177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185110}, {obj_id:2178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191697}, {obj_id:2179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217620}, {obj_id:2180, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221861}, {obj_id:2181, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185962}, {obj_id:2182, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:422104}, {obj_id:2183, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190931}, {obj_id:2184, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192945}, {obj_id:2185, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179350}, {obj_id:2186, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:2187, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188846}, {obj_id:2188, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417908}, {obj_id:2189, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180199}, {obj_id:2195, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207911}, {obj_id:2203, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188121}, {obj_id:2204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196915}, {obj_id:2205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385249}, {obj_id:2209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2211, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem [2024-06-24 16:58:31.523092] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=1665] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:31.538585] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=34] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13720, offset=3445674}, end_cursor:ObLogCursor{file_id=1, log_id=13721, offset=3445947}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c0c050, len:3158, log_data_len:273, seq:13720, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:31.540379] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D906-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219511539460000, start_id=1719219511539460000, end_id=1719219511539460001) [2024-06-24 16:58:31.540428] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D906-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=9025, avg_group_log_size=644) [2024-06-24 16:58:31.540446] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D906-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8447) [2024-06-24 16:58:31.540807] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7900) [2024-06-24 16:58:31.540863] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7900) [2024-06-24 16:58:31.540908] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=28, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=410, avg_log_submit_to_slide_time=423) [2024-06-24 16:58:31.541423] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13721, offset=3445947}, end_cursor:ObLogCursor{file_id=1, log_id=13722, offset=3446212}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c10050, len:2885, log_data_len:265, seq:13721, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:31.545105] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219511544744000, start_id=1719219511544744000, end_id=1719219511544744001) [2024-06-24 16:58:31.551163] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.558193] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1719219511557390000, start_id=1719219511557390000, end_id=1719219511557390001) [2024-06-24 16:58:31.570569] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95E82-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:31.575711] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.582224] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219511581715000, start_id=1719219511581715000, end_id=1719219511581715001) [2024-06-24 16:58:31.590649] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1719219501588412, end_time=1719219511590647, dag_status={}) [2024-06-24 16:58:31.590679] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590698] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590735] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590748] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590760] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590773] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590785] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:31.590798] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590815] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590828] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590839] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590849] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590862] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590875] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590901] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590927] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590940] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590954] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590964] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590986] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.590999] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591012] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591025] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591056] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591070] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591084] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591098] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591109] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591123] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591136] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591150] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591178] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591191] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591205] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591219] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591244] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591271] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591285] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591299] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591313] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591326] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591340] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591354] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591392] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591406] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591488] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591502] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591527] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591569] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:31.591583] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:31.591595] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:31.591484] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:31.591608] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:31.591615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:31.591634] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:31.591642] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:31.591610] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=125] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:31.591649] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:31.591661] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:31.591672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:31.591679] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:31.591691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:31.591699] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=42] dump tenant replay process(tenant_id=1003, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:31.603550] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1719219511405253000, v:0}, base_version={val:1719219511204349002, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219511405253000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219511603534, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:31.605523] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1719219511604915000, start_id=1719219511604915000, end_id=1719219511604915001) [2024-06-24 16:58:31.619655] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=18] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:31.620523] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:31.639079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283433857024, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:31.651217] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.661726] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=392, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:31.661738] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:31.661758] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:31.661787] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:31.661801] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:31.661818] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=466, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:31.661831] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:31.670326] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:31.675765] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.685093] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1353][T1004_LockWaitM][T1004][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=2620, bkt_cnt=7838) [2024-06-24 16:58:31.696573] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=59] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:31.699524] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=17] gc stale ls task succ [2024-06-24 16:58:31.715585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:31.719251] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=15] ====== tenant freeze timer task ====== [2024-06-24 16:58:31.719459] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219511718749000, start_id=1719219511718749000, end_id=1719219511718749001) [2024-06-24 16:58:31.721797] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:31.721829] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:31.721866] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=103033372, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:31.722672] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=18789, mem_used=103987200) [2024-06-24 16:58:31.729633] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=22] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:31.736457] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073A5D-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219511735615000, start_id=1719219511735615000, end_id=1719219511735615001) [2024-06-24 16:58:31.737002] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1073A5D-0-0] [lt=20] [APPLY STAT CB APPEND COST TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=33, this=0x7f473495c280, extra_info="") [2024-06-24 16:58:31.737031] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1073A5D-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=419, this=0x7f473495c4b0, extra_info="") [2024-06-24 16:58:31.737048] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1073A5D-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=0, this=0x7f473495c6e0, extra_info="") [2024-06-24 16:58:31.737065] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1073A5D-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=-387, this=0x7f473495c910, extra_info="") [2024-06-24 16:58:31.737079] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1073A5D-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=65, this=0x7f473495cb40, extra_info="") [2024-06-24 16:58:31.738043] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD799-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219511737688000, start_id=1719219511737688000, end_id=1719219511737688001) [2024-06-24 16:58:31.741190] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EBA-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:31.742973] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [1580][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=19][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1003, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:31.743064] WDIAG read_multi_row (ob_table_access_helper.h:238) [1580][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=28][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1003, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:31.744317] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EBB-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:31.745097] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219511745068000, start_id=1719219511745068000, end_id=1719219511745068001) [2024-06-24 16:58:31.745132] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:31.745147] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=7] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:31.745503] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=396, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:31.745531] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:31.745563] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:31.745593] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=452, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:31.745612] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=29, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:31.750082] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EBD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:31.751271] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.753125] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EBE-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:31.756429] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EC0-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:31.757970] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [338][T1002_TenantWea][T1001][YB42AC141156-00061B9D90313822-0-0] [lt=32] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.605527687072753906e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=380, Throttle Trigger(MB)=228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.385500888480237336e+02) [2024-06-24 16:58:31.758178] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1719219511757715000, start_id=1719219511757715000, end_id=1719219511757715001) [2024-06-24 16:58:31.761821] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:31.761846] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=434, avg_log_submit_to_slide_time=441) [2024-06-24 16:58:31.766675] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494461, support_ssl=false) [2024-06-24 16:58:31.766770] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=32] sm conn init succ(conn.sessid_=3221494461, sess.client_addr_="172.20.17.86:49498") [2024-06-24 16:58:31.766796] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f46bf5f6d70, session_id:3221494461, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:31.766844] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6d70, session_id:3221494461, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:31.766875] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=26] kill and revert session(conn.sessid_=3221494461, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:31.766897] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=21] sock ref clean, do destroy(*s={this:0x7f46bf5f6d70, session_id:3221494461, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:31.766921] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494461) [2024-06-24 16:58:31.766931] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=8] connection close(sessid=3221494461, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:31.775821] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.782143] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219511781955000, start_id=1719219511781955000, end_id=1719219511781955001) [2024-06-24 16:58:31.782541] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=40] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8351) [2024-06-24 16:58:31.782801] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ECB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:31.785946] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ECC-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:31.790718] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ECE-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:31.793673] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:31.793784] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:31.793987] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:31.794053] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:31.794218] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:31.794294] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:31.794402] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED0-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:31.805531] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219511805011000, start_id=1719219511805011000, end_id=1719219511805011001) [2024-06-24 16:58:31.822921] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=17] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:31.822951] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=20] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1232) [2024-06-24 16:58:31.824571] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=20, mem_used=49913856) [2024-06-24 16:58:31.824595] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=16] release old cannot free more memory [2024-06-24 16:58:31.824602] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=6] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=31, size_used=0, mem_used=49913856) [2024-06-24 16:58:31.833150] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219511832406000, start_id=1719219511832406000, end_id=1719219511832406001) [2024-06-24 16:58:31.834024] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16473, offset=3752419}, end_cursor:ObLogCursor{file_id=1, log_id=16474, offset=3752692}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c14050, len:3613, log_data_len:273, seq:16473, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:31.835299] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [1558][T1003_TntShared][T1003][Y0-0000000000000000-0-0] [lt=18] dump dtl interm result cost(us)(dump_cost=6, ret=0, interm count=0, dump count=616) [2024-06-24 16:58:31.835330] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [1558][T1003_TntShared][T1003][Y0-0000000000000000-0-0] [lt=26] clear dtl interm result cost(us)(clear_cost=3, ret=0, gc_.expire_keys_.count()=0, dump count=616, interm count=0, clean count=0) [2024-06-24 16:58:31.835905] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F7-0-0] [lt=36][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:31.835931] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F7-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:31.837986] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F7-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219511837683000, start_id=1719219511837683000, end_id=1719219511837683001) [2024-06-24 16:58:31.838083] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F7-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:31.838111] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F7-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7762) [2024-06-24 16:58:31.839143] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:31.839201] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=476, avg_log_submit_to_slide_time=490) [2024-06-24 16:58:31.839581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283438051328, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:31.839755] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16474, offset=3752692}, end_cursor:ObLogCursor{file_id=1, log_id=16475, offset=3752957}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c18050, len:3340, log_data_len:265, seq:16474, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:31.851325] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.855927] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=23] current monitor number(seq_=-1) [2024-06-24 16:58:31.861891] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=43] [APPLY STAT CB APPEND COST TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=23, this=0x7f46d7ab8280, extra_info="") [2024-06-24 16:58:31.861923] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=566, this=0x7f46d7ab84b0, extra_info="") [2024-06-24 16:58:31.861941] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=0, this=0x7f46d7ab86e0, extra_info="") [2024-06-24 16:58:31.861956] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=-531, this=0x7f46d7ab8910, extra_info="") [2024-06-24 16:58:31.861970] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=58, this=0x7f46d7ab8b40, extra_info="") [2024-06-24 16:58:31.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.873832] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.873829] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.873830] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874176] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874180] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874177] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874281] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874336] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874485] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874524] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874601] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874637] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874639] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=94] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.874777] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:31.875876] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.890538] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1719219511890536, bytes: 170608773, bw: 0.019785 MB/s, add_ts: 1007617, add_bytes: 20904 [2024-06-24 16:58:31.900000] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:262) [1660][T1004_ArcSender][T1004][YB42AC141156-00061B9D9590C0E5-0-0] [lt=31] ObArchiveSender is running(thread_index=1) [2024-06-24 16:58:31.911058] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:31.915640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:31.919586] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219511918870000, start_id=1719219511918870000, end_id=1719219511918870001) [2024-06-24 16:58:31.927454] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A25F5-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:31.929512] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95ED2-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:31.945333] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=5] get number(ret=0, service_type_=0, range=1, base_id=1719219511945312000, start_id=1719219511945312000, end_id=1719219511945312001) [2024-06-24 16:58:31.951380] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=9][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.958270] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219511957993000, start_id=1719219511957993000, end_id=1719219511957993001) [2024-06-24 16:58:31.961563] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:31.961600] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:31.961659] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=54] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:31.961682] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:31.961718] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:31.961737] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:31.962199] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=362, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:31.968330] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C7C7C-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:31.970609] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:31.970656] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=14, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=416, avg_log_submit_to_slide_time=428) [2024-06-24 16:58:31.970820] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EDF-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:31.975931] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:31.979713] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [162957][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=37] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f4841ffc2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:31.983529] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219511983324000, start_id=1719219511983324000, end_id=1719219511983324001) [2024-06-24 16:58:31.997346] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:787) [163649][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=32] ps cache evict(tenant_id=1, stmt_id_map_.size()=12, stmt_info_map_.size()=12, op.get_used_size()=26439, get_mem_high()=410706180, expired_stmt_ids.count()=0, closed_stmt_ids.count()=12) [2024-06-24 16:58:32.002386] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:32.005723] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219512005513000, start_id=1719219512005513000, end_id=1719219512005513001) [2024-06-24 16:58:32.008543] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=11] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1004) [2024-06-24 16:58:32.008575] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=27] start lib cache evict(tenant_id=1004, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:32.008596] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1004, cache_evict_num=0, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:32.008614] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:32.011521] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95EF2-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.015207] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=32] Dumping All Cache Objs(alloc_obj_list.count()=497, alloc_obj_list=[{obj_id:35, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:39, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:40, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184250}, {obj_id:41, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:43, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:45, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:53, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175298}, {obj_id:84, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174332}, {obj_id:145, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:146, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:147, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:148, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:151, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:152, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:153, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:154, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:155, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:156, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:157, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:158, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:159, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:160, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198897}, {obj_id:161, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:162, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:163, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:164, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:165, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:166, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:167, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:168, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:169, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:170, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:171, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:172, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:173, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:174, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:175, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:176, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:177, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175451}, {obj_id:178, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181217}, {obj_id:179, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:180, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:181, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:182, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235894}, {obj_id:183, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209782}, {obj_id:184, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230576}, {obj_id:185, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:186, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:187, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:188, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:189, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:190, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:191, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:192, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:193, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:195, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:196, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:197, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:198, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:199, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:200, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:201, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:202, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:203, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:204, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:205, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:206, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:207, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:208, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:209, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:210, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:211, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:212, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:213, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:214, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:215, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:216, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299219}, {obj_id:217, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236649}, {obj_id:218, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:219, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184514}, {obj_id:220, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:221, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:222, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:223, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180301}, {obj_id:224, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:225, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:226, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:227, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:228, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183169}, {obj_id:229, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:230, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:232, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:235, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:236, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:237, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:238, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:239, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:240, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:241, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:242, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188148}, {obj_id:243, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:244, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:245, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:246, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:247, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:248, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:249, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:250, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:251, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:252, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:253, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:254, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:255, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206580}, {obj_id:256, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208496}, {obj_id:257, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:258, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308540}, {obj_id:260, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207652}, {obj_id:261, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:262, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172752}, {obj_id:263, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:264, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:265, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:266, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:267, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:268, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:269, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:270, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:271, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:272, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157105}, {obj_id:273, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175095}, {obj_id:274, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176760}, {obj_id:275, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185989}, {obj_id:276, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:277, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:278, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:279, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419083}, {obj_id:280, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417152}, {obj_id:283, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239831}, {obj_id:284, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242976}, {obj_id:285, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256105}, {obj_id:286, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256298}, {obj_id:287, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:288, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:289, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:290, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:291, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:292, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:293, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:294, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231047}, {obj_id:295, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:296, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:297, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:298, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:299, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215340}, {obj_id:300, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:301, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:302, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:303, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:304, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:307, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:308, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:311, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:375291}, {obj_id:312, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:384468}, {obj_id:313, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325700}, {obj_id:314, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:334948}, {obj_id:315, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227240}, {obj_id:316, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268192}, {obj_id:317, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200156}, {obj_id:318, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206516}, {obj_id:335, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182820}, {obj_id:349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191406}, {obj_id:352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:362, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204485}, {obj_id:363, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224055}, {obj_id:366, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185366}, {obj_id:367, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195268}, {obj_id:368, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:375, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:376, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:379, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:380, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234934}, {obj_id:381, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:382, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:383, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:384, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218544}, {obj_id:385, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:386, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:387, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:388, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:391, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189184}, {obj_id:392, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201018}, {obj_id:395, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191754}, {obj_id:396, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204870}, {obj_id:399, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:400, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:403, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:404, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:407, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:408, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199110}, {obj_id:411, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:412, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:425, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:426, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:427, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:428, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:429, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:430, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217209}, {obj_id:431, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:432, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:433, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:434, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:437, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201929}, {obj_id:438, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220211}, {obj_id:441, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186646}, {obj_id:442, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197186}, {obj_id:449, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187051}, {obj_id:450, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236235}, {obj_id:451, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291681}, {obj_id:452, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229118}, {obj_id:453, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200168}, {obj_id:454, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219871}, {obj_id:455, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201375}, {obj_id:456, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291677}, {obj_id:457, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181926}, {obj_id:458, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201455}, {obj_id:461, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198111}, {obj_id:462, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214476}, {obj_id:473, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212131}, {obj_id:474, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235568}, {obj_id:489, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203200}, {obj_id:490, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222135}, {obj_id:493, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:494, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:497, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252923}, {obj_id:498, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296972}, {obj_id:509, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:510, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237536}, {obj_id:511, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292049}, {obj_id:512, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229486}, {obj_id:513, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200544}, {obj_id:514, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221206}, {obj_id:515, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201791}, {obj_id:516, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292045}, {obj_id:517, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182278}, {obj_id:518, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201839}, {obj_id:521, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263105}, {obj_id:522, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312324}, {obj_id:527, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269484}, {obj_id:528, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321943}, {obj_id:537, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254176}, {obj_id:538, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:298902}, {obj_id:551, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251638}, {obj_id:552, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295058}, {obj_id:555, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223603}, {obj_id:556, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252824}, {obj_id:573, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190308}, {obj_id:574, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238837}, {obj_id:575, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292385}, {obj_id:576, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229822}, {obj_id:577, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200872}, {obj_id:578, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222549}, {obj_id:579, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202111}, {obj_id:580, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292381}, {obj_id:581, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182630}, {obj_id:582, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202159}, {obj_id:587, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:588, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:611, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205738}, {obj_id:612, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225979}, {obj_id:625, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274568}, {obj_id:626, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329621}, {obj_id:643, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:644, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:645, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206454}, {obj_id:646, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:647, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:648, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:649, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197356}, {obj_id:650, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178512}, {obj_id:651, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198928}, {obj_id:652, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199105}, {obj_id:653, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156378}, {obj_id:654, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157162}, {obj_id:655, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176121}, {obj_id:656, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:657, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:307685}, {obj_id:658, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:660, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312830}, {obj_id:661, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:662, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:663, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:664, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202402}, {obj_id:665, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:666, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216429}, {obj_id:667, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:668, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157107}, {obj_id:669, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176570}, {obj_id:670, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176412}, {obj_id:672, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:673, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156195}, {obj_id:674, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:676, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:677, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372653}, {obj_id:678, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:679, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:680, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255326}, {obj_id:681, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255084}, {obj_id:682, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281876}, {obj_id:683, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319873}, {obj_id:684, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209231}, {obj_id:700, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192790}, {obj_id:701, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257630}, {obj_id:702, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234000}, {obj_id:731, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200128}, {obj_id:733, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:409897}, {obj_id:734, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:400862}, {obj_id:736, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175113}, {obj_id:737, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184566}, {obj_id:742, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175296}, {obj_id:743, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181792}, {obj_id:746, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185582}, {obj_id:747, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:797, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200312}, {obj_id:798, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198098}, {obj_id:799, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288253}, {obj_id:800, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:801, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200393}, {obj_id:802, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213250}, {obj_id:803, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328028}, {obj_id:804, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198852}, {obj_id:805, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:806, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:807, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:808, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:809, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174410}, {obj_id:815, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173948}, {obj_id:825, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185181}, {obj_id:828, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238944}, {obj_id:832, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:833, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:834, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:835, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:836, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188748}, {obj_id:837, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207583}, {obj_id:838, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220441}, {obj_id:839, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189684}, {obj_id:840, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183154}, {obj_id:841, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246969}, {obj_id:842, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249608}, {obj_id:843, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231450}, {obj_id:844, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180118}, {obj_id:845, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268752}, {obj_id:846, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270542}, {obj_id:847, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270227}, {obj_id:848, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273208}, {obj_id:849, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257627}, {obj_id:850, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273232}, {obj_id:851, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254489}, {obj_id:852, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269717}, {obj_id:853, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175231}, {obj_id:854, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181662}, {obj_id:855, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177134}, {obj_id:861, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177715}, {obj_id:869, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187847}, {obj_id:879, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200764}, {obj_id:880, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200755}, {obj_id:930, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:466821}, {obj_id:931, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:932, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296709}, {obj_id:933, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318958}, {obj_id:934, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312747}, {obj_id:935, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325200}, {obj_id:936, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217553}, {obj_id:937, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281577}, {obj_id:938, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189394}, {obj_id:939, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:641561}, {obj_id:940, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:244732}, {obj_id:941, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232660}, {obj_id:942, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:943, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:944, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217413}, {obj_id:945, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189522}, {obj_id:946, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232546}, {obj_id:1073, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246494}, {obj_id:1140, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:378647}, {obj_id:1141, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306509}, {obj_id:1142, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1143, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:1144, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198777}, {obj_id:1194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247404}, {obj_id:1320, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:438066}, {obj_id:1321, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260903}, {obj_id:1322, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206816}, {obj_id:1323, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193061}, {obj_id:1324, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178317}, {obj_id:1325, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182140}, {obj_id:1326, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174724}, {obj_id:1327, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195853}, {obj_id:1328, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184944}, {obj_id:1329, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201089}, {obj_id:1330, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209476}, {obj_id:1331, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:170609}, {obj_id:1332, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171169}, {obj_id:1333, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203806}, {obj_id:1334, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200651}, {obj_id:1336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195256}, {obj_id:1337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203334}, {obj_id:1338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198057}, {obj_id:1339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192160}, {obj_id:1340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194971}, {obj_id:1341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196164}, {obj_id:1342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198958}, {obj_id:1343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197940}, {obj_id:1344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200683}, {obj_id:1345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197036}, {obj_id:1346, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199801}, {obj_id:1347, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204590}, {obj_id:1348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197459}, {obj_id:1349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207323}, {obj_id:1350, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200262}, {obj_id:1351, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197164}, {obj_id:1353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199224}, {obj_id:1354, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201933}, {obj_id:1355, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202018}, {obj_id:1356, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206006}, {obj_id:1357, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204664}, {obj_id:1358, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205068}, {obj_id:1359, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208689}, {obj_id:1360, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207750}, {obj_id:1361, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209040}, {obj_id:13 [2024-06-24 16:58:32.016873] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=1662] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:32.024332] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1453][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=37] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:32.026906] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 367.50) [2024-06-24 16:58:32.026921] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:32.027005] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 366.50) [2024-06-24 16:58:32.027014] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:32.027031] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027044] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027050] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027063] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027068] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027075] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027081] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027088] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027094] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027102] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027107] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027115] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027125] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.027132] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:32.040104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283431759872, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:32.051434] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.053595] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:32.070124] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:32.070168] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:32.070197] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:32.070220] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:32.070595] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=341, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:32.070615] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:32.070599] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=373, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:32.070646] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:32.070665] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:32.070693] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=416, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:32.070712] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=24, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:32.070748] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:32.070762] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=469, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:32.070776] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=28, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:32.075986] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.079180] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=15] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:32.079208] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=19] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:32.079228] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1231) [2024-06-24 16:58:32.094475] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=413, mem_used=2079744) [2024-06-24 16:58:32.096256] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096723] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096720] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096915] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.096946] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097102] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097219] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097351] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097560] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097649] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097665] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097675] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097686] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097722] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097718] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097787] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.097840] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:32.097918] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098149] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098202] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098359] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098490] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098495] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098550] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098561] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098558] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=6] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098664] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098703] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098703] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.098972] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.099647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.104219] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:32.111060] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:32.111083] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:32.111110] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=13] cannot_recycle_log_size statistics(cannot_recycle_log_size=73492851, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:32.112239] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1B-0-0] [lt=20] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:32.112266] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1B-0-0] [lt=19] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=29) [2024-06-24 16:58:32.115745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:32.119918] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] submit log success(service_type_=0, last_id=1719219528711542000, limited_id=1719219528711542000) [2024-06-24 16:58:32.119954] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] submit log with lock success(service_type_=0, last_id=1719219528711542000, limited_id=1719219528711542000) [2024-06-24 16:58:32.119971] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219512119150000, start_id=1719219512119150000, end_id=1719219512119150001) [2024-06-24 16:58:32.120306] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3078) [2024-06-24 16:58:32.120341] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=446, avg_log_submit_to_slide_time=456) [2024-06-24 16:58:32.120371] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=15] update id meta(ret=0, service_type=0, limited_id=1719219528711542000, latest_scn={val:1719219512119150001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:32.120455] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=82] handle submit callback(service_type_=0, success=true, used_ts=538, log_ts={val:1719219512119150001, v:0}, limited_id=1719219528711542000) [2024-06-24 16:58:32.120476] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:32.120493] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:32.120699] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB40-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219512120205000, start_id=1719219512120205000, end_id=1719219512120205001) [2024-06-24 16:58:32.129633] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1387][T1004_ArcSender][T1004][YB42AC141156-00061B9D9370C0E5-0-0] [lt=16][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:32.132534] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=18] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:32.133124] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=30] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:32.137922] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D4-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:32.137951] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D4-0-0] [lt=26] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:32.138597] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EF-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:32.138649] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8EF-0-0] [lt=49] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:32.145488] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219512144491000, start_id=1719219512144491000, end_id=1719219512144491001) [2024-06-24 16:58:32.151490] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.152498] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:32.152696] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B4-0-0] [lt=24] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:32.152847] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B4-0-0] [lt=143] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:32.158394] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219512158155000, start_id=1719219512158155000, end_id=1719219512158155001) [2024-06-24 16:58:32.161095] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F2E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:32.162061] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:32.162085] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:32.162102] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=402, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:32.162116] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=22, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:32.163800] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F2F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:32.168732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F31-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:32.170197] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:32.170227] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:32.170267] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=5723, avg_group_log_size=408) [2024-06-24 16:58:32.170286] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=5723) [2024-06-24 16:58:32.171341] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F32-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:32.174151] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F33-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:32.174652] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=22] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:32.176042] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.183709] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219512183489000, start_id=1719219512183489000, end_id=1719219512183489001) [2024-06-24 16:58:32.196174] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=14] ====== traversal_flush timer task ====== [2024-06-24 16:58:32.196417] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F3C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:32.196351] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B4-0-0] [lt=21] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219509328146004, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:32.196757] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B4-0-0] [lt=124] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219511833460003, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219509328146004, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:32.196874] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B4-0-0] [lt=114] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:32.199071] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F3D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.201110] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=31] gc stale ls task succ [2024-06-24 16:58:32.203172] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F3F-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:32.205864] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219512205660000, start_id=1719219512205660000, end_id=1719219512205660001) [2024-06-24 16:58:32.205938] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:32.205973] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:32.206046] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:32.206143] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:32.206313] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:32.206372] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:32.206511] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:32.206574] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:32.206672] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F41-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:32.209059] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A0-0-0] [lt=53][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:32.219196] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A27D8-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:32.235842] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:32.235872] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3662, avg_group_log_size=332) [2024-06-24 16:58:32.235898] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3662) [2024-06-24 16:58:32.235916] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:32.236208] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3662) [2024-06-24 16:58:32.236250] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:32.236260] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=483, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:32.236266] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=17, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:32.240616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283431759872, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:32.251544] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.255159] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F50-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:32.257893] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F51-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:32.276097] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.276899] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:32.276917] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E0-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:32.276938] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E0-0-0] [lt=17] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:32.276938] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=38] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:32.305168] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F63-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.315855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:32.320300] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219512319710000, start_id=1719219512319710000, end_id=1719219512319710001) [2024-06-24 16:58:32.325126] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111603, mem_used=262047744) [2024-06-24 16:58:32.334070] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219512333446000, start_id=1719219512333446000, end_id=1719219512333446001) [2024-06-24 16:58:32.334116] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:32.334570] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=371, get_gts_with_stc_cnt=1, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=1, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:32.334605] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=33] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219512334539], gts:1719219512334503000, latest_srr:[mts=1719219512334539]}) [2024-06-24 16:58:32.341868] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=30] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:32.344537] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=21] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:32.344683] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=146] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:32.344742] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=17] dump tenant replay process(tenant_id=1, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:32.345601] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219512345045000, start_id=1719219512345045000, end_id=1719219512345045001) [2024-06-24 16:58:32.351600] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.358514] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219512357687000, start_id=1719219512357687000, end_id=1719219512357687001) [2024-06-24 16:58:32.359140] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219511832406001, v:0}, new_max_version={val:1719219511832406001, v:0}, last_min_version={val:1719219511737688000, v:0}, last_max_version={val:1719219511737688000, v:0}, total_time_us=2589, delta_us=526732) [2024-06-24 16:58:32.359177] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219511832406001, v:0}, min_version={val:1719219511832406001, v:0}, max_version={val:1719219511832406001, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:32.360758] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [162947][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=22][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:32.360871] WDIAG read_multi_row (ob_table_access_helper.h:238) [162947][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=35][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:32.361858] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:32.361890] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:32.373190] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] [COMPACTION DAG STATUS] (start_time=1719219502371186, end_time=1719219512373186, dag_status={}) [2024-06-24 16:58:32.373229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373252] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373268] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373283] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373303] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373318] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373332] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373346] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373363] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:32.373378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373398] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373414] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373430] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373446] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373476] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373494] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373510] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373526] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373542] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373559] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373575] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373591] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373607] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373638] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373657] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373674] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373690] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373706] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373722] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373754] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373770] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373802] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373814] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373846] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373862] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373879] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373895] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373913] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373929] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373945] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373959] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.373990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374006] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374022] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374038] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374071] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374087] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374119] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374132] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374148] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374183] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374199] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374231] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374263] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374279] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374274] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1719217706692887000, duration=1800, snapshot_gc_ts=1719219506692887000) [2024-06-24 16:58:32.374293] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374312] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:32.374329] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:32.374343] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:32.374357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:32.374366] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:32.374378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:32.374386] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:32.374397] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:32.374405] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:32.374416] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:32.374425] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:32.374438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:32.374790] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=22] update reserved snapshot finished(cost_ts=519, reserved_snapshot=1719217706692887000) [2024-06-24 16:58:32.376153] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.383790] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219512383028000, start_id=1719219512383028000, end_id=1719219512383028001) [2024-06-24 16:58:32.405948] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219512405119000, start_id=1719219512405119000, end_id=1719219512405119001) [2024-06-24 16:58:32.406375] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=346, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:32.406409] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:32.406428] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:32.406453] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=404, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:32.406470] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=21, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:32.406551] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:32.419521] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=129638, mem_used=326519808) [2024-06-24 16:58:32.436321] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=392, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:32.436345] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:32.441159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283427565568, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:32.451633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.457357] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:32.462382] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:32.462371] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=55] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:32.462421] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=392, avg_log_submit_to_slide_time=401) [2024-06-24 16:58:32.470756] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3252) [2024-06-24 16:58:32.470802] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=3252) [2024-06-24 16:58:32.470837] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=360, avg_log_submit_to_slide_time=371) [2024-06-24 16:58:32.471611] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2952-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:32.471937] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2952-0-0] [lt=62][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:32.472433] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2952-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:32.472890] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2952-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:32.473170] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2952-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:32.476207] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.477312] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95F9F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:32.479957] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:32.480431] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FA0-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:32.483522] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] Garbage Collector is running(seq_=627, gc_interval=10000000) [2024-06-24 16:58:32.483588] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=27] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:32.483620] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] gc_check_member_list_ cost time(ret=0, time_us=68) [2024-06-24 16:58:32.483665] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=40] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:32.483683] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:32.483704] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:32.483722] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] execute_gc cost time(ret=0, time_us=20) [2024-06-24 16:58:32.483735] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2024-06-24 16:58:32.484265] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=17] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:32.484314] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=36] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1252) [2024-06-24 16:58:32.486102] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FA2-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:32.489137] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FA3-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:32.492380] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FA4-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:32.493395] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD7A9-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219512492519000, start_id=1719219512492519000, end_id=1719219512492519001) [2024-06-24 16:58:32.499002] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB42-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103408590369, cache_obj->added_lc()=false, cache_obj->get_object_id()=9352, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:32.499004] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:32.506801] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [1614][T1003_MediumLoo][T1003][YB42AC141156-00061B9D98E0C24B-0-0] [lt=31] MediumCheckTask(cost_ts=38) [2024-06-24 16:58:32.508183] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073AC4-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219512507320000, start_id=1719219512507320000, end_id=1719219512507320001) [2024-06-24 16:58:32.510219] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=19] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:32.512071] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=33] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:32.512167] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=26] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506692887000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:32.515960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:32.518014] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1719219512319710000, v:0}, base_version={val:1719219512119150002, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219512319710000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219512517992, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:32.519527] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FAC-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:32.520523] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219512519995000, start_id=1719219512519995000, end_id=1719219512519995001) [2024-06-24 16:58:32.522714] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FAD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.523126] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=28][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:32.527526] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FAF-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:32.527812] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1719219512527808, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-06-24 16:58:32.530698] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:32.530811] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:32.531024] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:32.531088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:32.531257] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:32.531332] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:32.531436] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB1-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:32.540080] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=35] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:32.543915] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FB3-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:32.544168] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=21] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13722, offset=3446212}, end_cursor:ObLogCursor{file_id=1, log_id=13723, offset=3446485}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c1c050, len:2620, log_data_len:273, seq:13722, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:32.546197] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D907-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219512545350000, start_id=1719219512545350000, end_id=1719219512545350001) [2024-06-24 16:58:32.546253] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D907-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7884, avg_group_log_size=606) [2024-06-24 16:58:32.546270] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D907-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7883) [2024-06-24 16:58:32.546603] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7884) [2024-06-24 16:58:32.546666] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7884) [2024-06-24 16:58:32.546700] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=380, avg_log_submit_to_slide_time=388) [2024-06-24 16:58:32.546808] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219512546408000, start_id=1719219512546408000, end_id=1719219512546408001) [2024-06-24 16:58:32.547199] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13723, offset=3446485}, end_cursor:ObLogCursor{file_id=1, log_id=13724, offset=3446750}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c20050, len:2347, log_data_len:265, seq:13723, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:32.551651] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.553882] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1719217706733030000, duration=1800, snapshot_gc_ts=1719219506733030000) [2024-06-24 16:58:32.554430] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=18] update reserved snapshot finished(cost_ts=551, reserved_snapshot=1719217706733030000) [2024-06-24 16:58:32.558569] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219512558050000, start_id=1719219512558050000, end_id=1719219512558050001) [2024-06-24 16:58:32.575224] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C80C9-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:32.575348] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C80C9-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:32.576263] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.579008] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2A11-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:32.582980] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FBF-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:32.583913] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219512583402000, start_id=1719219512583402000, end_id=1719219512583402001) [2024-06-24 16:58:32.586305] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF82-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:32.601294] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:32.606078] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219512605601000, start_id=1719219512605601000, end_id=1719219512605601001) [2024-06-24 16:58:32.619772] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:32.620591] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=16] gc stale ls task succ [2024-06-24 16:58:32.625877] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:32.626007] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:32.626059] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:32.626103] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:32.626181] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:32.626312] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:32.626361] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:32.626401] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:32.626520] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:32.626567] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:32.626647] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:32.626686] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:32.626783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:32.626824] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:32.626861] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:32.626920] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:32.626930] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [162940][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=37] finish to resize log external storage handler(current_ts=1719219512626920, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:32.627013] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:32.627053] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:32.627090] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:32.627127] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:32.627193] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:32.627232] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:32.627312] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:32.627351] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8126-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:32.639964] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB95FD2-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.641727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283431759872, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:32.651708] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.654518] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD4F-0-0] [lt=29] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:32.657352] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C815D-0-0] [lt=8][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:32.658361] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8161-0-0] [lt=17][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:32.662529] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=391, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:32.662540] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:32.662560] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:32.662588] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:32.662601] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:32.662616] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=460, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:32.662636] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:32.676321] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.699586] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:32.713204] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [163714][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=59] BlockGCTimerTask success(ret=0, cost_time_us=9, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):22118, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):22118, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):460, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:32.716062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:32.720150] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219512719663000, start_id=1719219512719663000, end_id=1719219512719663001) [2024-06-24 16:58:32.722808] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=22535, mem_used=112306176) [2024-06-24 16:58:32.729721] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:32.736316] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=43] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:32.746857] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219512746069000, start_id=1719219512746069000, end_id=1719219512746069001) [2024-06-24 16:58:32.746932] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:32.746966] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:32.747352] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=427, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:32.747382] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:32.747410] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:32.747437] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=487, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:32.747456] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:32.751764] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.758714] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219512757695000, start_id=1719219512757695000, end_id=1719219512757695001) [2024-06-24 16:58:32.762528] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:32.762555] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=440, avg_log_submit_to_slide_time=446) [2024-06-24 16:58:32.765845] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494462, support_ssl=false) [2024-06-24 16:58:32.765924] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221494462, sess.client_addr_="172.20.17.86:49500") [2024-06-24 16:58:32.765947] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f46bf5f6030, session_id:3221494462, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:32.765990] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:153) [1472][T1003_COMMONLSS][T1003][YB42AC141156-00061B9D9940D89B-0-0] [lt=39][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2024-06-24 16:58:32.766025] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6030, session_id:3221494462, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:32.766057] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494462, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:32.766074] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f46bf5f6030, session_id:3221494462, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:32.766098] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494462) [2024-06-24 16:58:32.766111] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494462, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:32.770909] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:32.776376] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.784012] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219512783012000, start_id=1719219512783012000, end_id=1719219512783012001) [2024-06-24 16:58:32.784463] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7877) [2024-06-24 16:58:32.803274] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2B12-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:32.804061] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9600C-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:32.806163] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219512805211000, start_id=1719219512805211000, end_id=1719219512805211001) [2024-06-24 16:58:32.807117] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9600D-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:32.811197] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=8] ====== check clog disk timer task ====== [2024-06-24 16:58:32.811215] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=11] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=114) [2024-06-24 16:58:32.811238] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=53446477, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:32.812862] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9600F-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:32.816048] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96010-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:32.819401] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96012-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:32.824653] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=6] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=21, mem_used=49913856) [2024-06-24 16:58:32.824671] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=12] release old cannot free more memory [2024-06-24 16:58:32.824676] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=4] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=24, size_used=0, mem_used=49913856) [2024-06-24 16:58:32.835046] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=61] get number(ret=0, service_type_=0, range=1, base_id=1719219512834696000, start_id=1719219512834696000, end_id=1719219512834696001) [2024-06-24 16:58:32.835079] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=26] ts response task statistics(alloc_count=248078, free_count=124038) [2024-06-24 16:58:32.835119] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219512835037], gts:1719219512834696000, latest_srr:[mts=1719219512835037]}) [2024-06-24 16:58:32.835159] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219512835145], gts:1719219512834696000, latest_srr:[mts=1719219512835145]}) [2024-06-24 16:58:32.835190] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219512835176], gts:1719219512834696000, latest_srr:[mts=1719219512835176]}) [2024-06-24 16:58:32.835221] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] gts statistics(tenant_id=1003, gts_rpc_cnt=11, get_gts_cache_cnt=399, get_gts_with_stc_cnt=59, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=59, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:32.835241] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219512835206], gts:1719219512834696000, latest_srr:[mts=1719219512835206]}) [2024-06-24 16:58:32.838075] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=18] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:32.838122] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:32.838149] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1249) [2024-06-24 16:58:32.842245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283421274112, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:32.843801] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=28] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16475, offset=3752957}, end_cursor:ObLogCursor{file_id=1, log_id=16476, offset=3753230}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c24050, len:3075, log_data_len:273, seq:16475, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:32.844908] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9601B-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:32.845662] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F8-0-0] [lt=30][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:32.845687] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F8-0-0] [lt=23][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:32.846498] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F8-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336743803024291992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.886405955689659208e+01) [2024-06-24 16:58:32.847803] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F8-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1719219512847341000, start_id=1719219512847341000, end_id=1719219512847341001) [2024-06-24 16:58:32.847895] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F8-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7877, avg_group_log_size=605) [2024-06-24 16:58:32.847924] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F8-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7877) [2024-06-24 16:58:32.847926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9601C-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.848285] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7877) [2024-06-24 16:58:32.848346] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=413, avg_log_submit_to_slide_time=424) [2024-06-24 16:58:32.848887] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16476, offset=3753230}, end_cursor:ObLogCursor{file_id=1, log_id=16477, offset=3753495}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c28050, len:2802, log_data_len:265, seq:16476, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:32.851819] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.852548] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9601E-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:32.855403] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:32.855513] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:32.855731] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:32.855797] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:32.855963] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:32.856038] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:32.856044] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=25] current monitor number(seq_=-1) [2024-06-24 16:58:32.856145] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96020-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:32.864667] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=16710058, clean_num=201326) [2024-06-24 16:58:32.866085] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [825][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=43] BlockGCTimerTask success(ret=0, cost_time_us=7, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):2457, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):2457, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):130, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:32.873529] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96021-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:32.873612] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873674] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873685] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=7] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873734] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873836] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.873842] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874082] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874089] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874104] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874221] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874232] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874379] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874389] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874541] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874566] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874586] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874591] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874594] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874685] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.874828] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:32.876431] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.889745] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2B61-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219512889499000, start_id=1719219512889499000, end_id=1719219512889499001) [2024-06-24 16:58:32.898153] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1719219512898151, bytes: 170629828, bw: 0.019928 MB/s, add_ts: 1007615, add_bytes: 21055 [2024-06-24 16:58:32.900274] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=62] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:32.906264] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:32.906519] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5C8-0-0] [lt=31] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:32.906675] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5C8-0-0] [lt=149] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:32.911120] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:32.912853] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C83F6-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:32.915917] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96030-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:32.919704] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219512919085000, start_id=1719219512919085000, end_id=1719219512919085001) [2024-06-24 16:58:32.929648] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=81900000, replace_num=100000) [2024-06-24 16:58:32.929678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:32.936938] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=11] Garbage Collector is running(seq_=617, gc_interval=10000000) [2024-06-24 16:58:32.936995] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=25] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:32.937019] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=55) [2024-06-24 16:58:32.937034] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=11] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:32.938436] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=10] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:32.938467] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=26] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:32.938484] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=15] execute_gc cost time(ret=0, time_us=17) [2024-06-24 16:58:32.938492] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=7] ObSafeDestroyHandler start process [2024-06-24 16:58:32.946998] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219512946552000, start_id=1719219512946552000, end_id=1719219512946552001) [2024-06-24 16:58:32.951875] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.952379] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:32.958818] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219512958144000, start_id=1719219512958144000, end_id=1719219512958144001) [2024-06-24 16:58:32.962248] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:32.962285] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:32.962310] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:32.962331] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:32.962363] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:32.962381] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:32.962647] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=367, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:32.965604] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96043-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:32.976486] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:32.984143] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219512983483000, start_id=1719219512983483000, end_id=1719219512983483001) [2024-06-24 16:58:32.986304] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=51] LogLoopThread round_cost_time(us)(round_cost_time=17) [2024-06-24 16:58:33.002446] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:33.006268] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219513005654000, start_id=1719219513005654000, end_id=1719219513005654001) [2024-06-24 16:58:33.009285] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:174) [1331][T1004_CdcSrv][T1004][Y0-0000000000000000-0-0] [lt=18] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2024-06-24 16:58:33.009321] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [1331][T1004_CdcSrv][T1004][Y0-0000000000000000-0-0] [lt=32] finish to resize log external storage handler(current_ts=1719219513009318, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:33.028304] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 363.50) [2024-06-24 16:58:33.028319] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:33.028382] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 366.00) [2024-06-24 16:58:33.028391] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:33.028406] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028416] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028423] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028429] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028435] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028441] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028447] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028452] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028460] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028474] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028480] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028487] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028492] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028499] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.028507] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:33.035126] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2024-06-24 16:58:33.035155] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:33.035189] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348733476, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:33.051930] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.053767] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:33.065180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283423371264, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:33.070711] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:33.070748] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:33.070774] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:33.070796] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:33.071123] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=329, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:33.071140] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:33.071131] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=366, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:33.071154] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:33.071169] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:33.071197] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=383, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:33.071216] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=29, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:33.071238] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:33.071269] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:33.071283] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=448, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:33.071296] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=440, avg_log_submit_to_slide_time=449) [2024-06-24 16:58:33.071317] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=21, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:33.076542] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.094635] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=449, mem_used=2079744) [2024-06-24 16:58:33.096107] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.096756] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.096758] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.096850] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.096853] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.096963] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097068] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097146] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097259] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097258] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097260] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097264] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097324] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097327] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=6] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097409] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097438] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097568] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097660] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097692] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097721] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097810] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097884] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097893] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.097886] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098192] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098195] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098233] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098607] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098642] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098666] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098662] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098667] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098718] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.098747] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.099009] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.099643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.106584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9607A-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.109114] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9607B-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.111384] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=49] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2024-06-24 16:58:33.113309] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=33] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2024-06-24 16:58:33.113339] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1001) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=27] no transfer partition job [2024-06-24 16:58:33.113359] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1031) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=16] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer={value_str:"True"}) [2024-06-24 16:58:33.113816] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9607D-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.116288] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9607E-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.116988] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=20] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2024-06-24 16:58:33.117047] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:482) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=42] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2024-06-24 16:58:33.118916] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9607F-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.119840] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219513119692000, start_id=1719219513119692000, end_id=1719219513119692001) [2024-06-24 16:58:33.120704] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=36][errcode=-4152] get obj error(ret=-4152) [2024-06-24 16:58:33.120797] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34D-0-0] [lt=28] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1719213346325391, last_statistic_bg_stat_time=1719215758515812, last_statistic_schema_version=1719215719009064, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2024-06-24 16:58:33.129766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:33.133239] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=18] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:33.138748] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96088-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.139346] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D5-0-0] [lt=17] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:33.139373] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D5-0-0] [lt=25] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:33.140542] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F0-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:33.140576] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F0-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:33.140966] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96089-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.145186] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8602-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.147108] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513146122000, start_id=1719219513146122000, end_id=1719219513146122001) [2024-06-24 16:58:33.147515] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:33.147605] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:33.147782] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:33.147835] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:33.147965] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:33.148027] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:33.148108] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608C-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:33.151977] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.153641] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9608D-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.158918] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513158781000, start_id=1719219513158781000, end_id=1719219513158781001) [2024-06-24 16:58:33.162818] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:33.162842] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:33.162858] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=424, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:33.162869] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=9] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=20, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:33.170785] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:33.170814] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:33.170859] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2690, avg_group_log_size=244) [2024-06-24 16:58:33.170878] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2690) [2024-06-24 16:58:33.174750] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=25] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:33.176597] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=8][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.177548] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D424-0-0] [lt=21] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:33.184009] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9609A-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.184221] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513184109000, start_id=1719219513184109000, end_id=1719219513184109001) [2024-06-24 16:58:33.186325] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9609B-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.192896] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1719217707115876000, duration=1800, snapshot_gc_ts=1719219507115876000) [2024-06-24 16:58:33.193315] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=32429336, this={dio_aligned_buf:{buf_write_offset:1416, buf_padding_size:2680, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:83662, truncate_used_ts:20992}, log_block_size:67108864, dir_fd:671, io_fd:673}, aligned_buf_len=4096, aligned_block_offset=32428032, buf_len=112, total_write_size_=12743, total_write_size_after_dio_=389120, ob_pwrite_used_ts=33114, count=92, each_pwrite_cost=359) [2024-06-24 16:58:33.193447] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=26] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217707115876000) [2024-06-24 16:58:33.193813] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=47893748, this={dio_aligned_buf:{buf_write_offset:3428, buf_padding_size:668, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:320570, truncate_used_ts:34971}, log_block_size:67108864, dir_fd:675, io_fd:677}, aligned_buf_len=4096, aligned_block_offset=47890432, buf_len=112, total_write_size_=58714, total_write_size_after_dio_=643072, ob_pwrite_used_ts=97549, count=143, each_pwrite_cost=682) [2024-06-24 16:58:33.193945] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=20] update reserved snapshot finished(cost_ts=1052, reserved_snapshot=1719217707115876000) [2024-06-24 16:58:33.199654] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=36] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:33.201175] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=13] gc stale ls task succ [2024-06-24 16:58:33.201410] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:33.201514] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506784804000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:33.206377] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513206243000, start_id=1719219513206243000, end_id=1719219513206243001) [2024-06-24 16:58:33.206452] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:33.206485] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:33.219988] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A1-0-0] [lt=48][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:33.222257] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D474-0-0] [lt=17] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:33.226572] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960AE-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.236376] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:33.236415] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2024-06-24 16:58:33.236443] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3535) [2024-06-24 16:58:33.236465] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:33.236716] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3535) [2024-06-24 16:58:33.236751] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=6] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4241) [2024-06-24 16:58:33.236797] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:33.236818] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=450, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:33.236835] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=29, avg_log_gen_to_submit_time=40, avg_log_submit_to_flush_time=413, avg_log_submit_to_slide_time=422) [2024-06-24 16:58:33.236858] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=24, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:33.239220] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2CF3-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513238928000, start_id=1719219513238928000, end_id=1719219513238928001) [2024-06-24 16:58:33.252031] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.253077] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=5] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:33.253091] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=12] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:33.253100] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=8] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:33.253111] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=10] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:33.256718] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=5] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:92233720368547 [2024-06-24 16:58:33.257723] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1003] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:33.265750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283421274112, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:33.270811] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:33.270835] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] try gc retain ctx [2024-06-24 16:58:33.270860] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=8] get_max_applied_scn(scn={val:1719219512889499002, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32425352}, palf_committed_end_scn_:{val:1719219512889499002, v:0}, last_check_scn_:{val:1719219512889499002, v:0}, max_applied_cb_scn_:{val:1719219512889499002, v:0}}) [2024-06-24 16:58:33.270894] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:33.273245] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=101] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219510516603000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:33.275633] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=106] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219510516603000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:33.276632] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.300450] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2024-06-24 16:58:33.300480] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:33.300508] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=70253626, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:33.301429] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=32] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:33.317698] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [162981][T1_MediumLoop][T1][YB42AC141156-00061B9D8A80C251-0-0] [lt=13] MediumCheckTask(cost_ts=43) [2024-06-24 16:58:33.319919] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219513319158000, start_id=1719219513319158000, end_id=1719219513319158001) [2024-06-24 16:58:33.322317] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=10] ====== tenant freeze timer task ====== [2024-06-24 16:58:33.325246] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111632, mem_used=262047744) [2024-06-24 16:58:33.329857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:33.332643] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073B2D-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219513331845000, start_id=1719219513331845000, end_id=1719219513331845001) [2024-06-24 16:58:33.332848] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD7D4-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513331845000, start_id=1719219513331845001, end_id=1719219513331845002) [2024-06-24 16:58:33.336018] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219513335016000, start_id=1719219513335016000, end_id=1719219513335016001) [2024-06-24 16:58:33.336068] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=437, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:33.336092] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:33.341998] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:33.342736] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960E9-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.344725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960EA-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.347229] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513346653000, start_id=1719219513346653000, end_id=1719219513346653001) [2024-06-24 16:58:33.348329] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960EC-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.350269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960ED-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.352087] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.352412] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960EE-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.359196] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513358243000, start_id=1719219513358243000, end_id=1719219513358243001) [2024-06-24 16:58:33.359791] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219512889499000, v:0}, new_max_version={val:1719219512889499000, v:0}, last_min_version={val:1719219512834696000, v:0}, last_max_version={val:1719219512834696000, v:0}, total_time_us=2670, delta_us=470290) [2024-06-24 16:58:33.359827] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219512889499000, v:0}, min_version={val:1719219512889499000, v:0}, max_version={val:1719219512889499000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:33.362537] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:33.362569] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:33.369154] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960F8-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.371106] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960F9-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.374155] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FB-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.375913] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:33.375986] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:33.376122] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:33.376166] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:33.376278] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:33.376330] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:33.376398] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FD-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:33.376687] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.381732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB960FE-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.384377] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513383614000, start_id=1719219513383614000, end_id=1719219513383614001) [2024-06-24 16:58:33.386757] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=44] LogLoopThread round_cost_time(us)(round_cost_time=11) [2024-06-24 16:58:33.397499] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1719217706784804000, duration=1800, snapshot_gc_ts=1719219506784804000) [2024-06-24 16:58:33.397985] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=45072237, this={dio_aligned_buf:{buf_write_offset:4061, buf_padding_size:35, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:88001, truncate_used_ts:22695}, log_block_size:67108864, dir_fd:686, io_fd:688}, aligned_buf_len=4096, aligned_block_offset=45068288, buf_len=112, total_write_size_=13841, total_write_size_after_dio_=425984, ob_pwrite_used_ts=39808, count=101, each_pwrite_cost=394) [2024-06-24 16:58:33.398211] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=22] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217706784804000) [2024-06-24 16:58:33.398554] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=57973475, this={dio_aligned_buf:{buf_write_offset:2899, buf_padding_size:1197, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:102289, truncate_used_ts:26479}, log_block_size:67108864, dir_fd:690, io_fd:692}, aligned_buf_len=4096, aligned_block_offset=57970688, buf_len=112, total_write_size_=12294, total_write_size_after_dio_=425984, ob_pwrite_used_ts=39378, count=101, each_pwrite_cost=389) [2024-06-24 16:58:33.398731] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=18] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1719217706784804000) [2024-06-24 16:58:33.398747] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=15] update reserved snapshot finished(cost_ts=1252, reserved_snapshot=1719217706784804000) [2024-06-24 16:58:33.406566] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219513405800000, start_id=1719219513405800000, end_id=1719219513405800001) [2024-06-24 16:58:33.406987] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=342, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:33.407005] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:33.407022] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=4, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:33.407035] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=397, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:33.407043] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=18, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:33.408140] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9610D-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.410153] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9610E-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.419672] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129649, mem_used=326519808) [2024-06-24 16:58:33.436095] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:33.436836] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=376, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:33.436852] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:33.438280] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=21] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:33.438326] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=45] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:33.438380] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=46] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:33.438530] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219510459535003, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:33.438660] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=125] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:33.438711] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=43] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:33.438737] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1719219507324493001, v:0}) [2024-06-24 16:58:33.438751] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:33.438772] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:33.438802] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:33.438827] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:33.440962] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:33.440992] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=30] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:33.441024] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=29] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:33.441254] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=22] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219510459535003, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:33.441359] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=102] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:33.441379] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:33.441400] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:33.441421] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:33.441440] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:33.441457] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=16] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:33.443465] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=15] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:33.445228] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:33.445338] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506733030000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:33.445372] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:651) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=31] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1719219506733030000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1003, freeze_info:{latest_snapshot_gc_scn:{val:1719219506733030000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}}) [2024-06-24 16:58:33.447658] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96121-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.447682] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:33.447705] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:33.447721] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=14] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:33.447735] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=12] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:33.452146] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.452429] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=10] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:33.452674] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=241] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:33.462971] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1332) [2024-06-24 16:58:33.463013] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=391, avg_log_submit_to_slide_time=399) [2024-06-24 16:58:33.463036] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=13, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:33.463066] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=29] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=460, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:33.463083] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:33.463098] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-599, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:33.463112] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-124, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:33.465855] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=109] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:33.465867] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] try gc retain ctx [2024-06-24 16:58:33.465885] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=4] get_max_applied_scn(scn={val:1719219513405800000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70254805}, palf_committed_end_scn_:{val:1719219513405800000, v:0}, last_check_scn_:{val:1719219513405800000, v:0}, max_applied_cb_scn_:{val:1719219513405800000, v:0}}) [2024-06-24 16:58:33.465904] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=16] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:33.466283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283423371264, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:33.467107] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=57] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:33.476742] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.480072] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:33.492105] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:153) [841][T1001_COMMONLSS][T1001][YB42AC141156-00061B9D92A0D8B9-0-0] [lt=32][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2024-06-24 16:58:33.499479] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D43A-0-0] [lt=25] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:33.505449] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB43-0-0] [lt=32][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103409596817, cache_obj->added_lc()=false, cache_obj->get_object_id()=9353, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:33.512549] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD7E7-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219513511569000, start_id=1719219513511569000, end_id=1719219513511569001) [2024-06-24 16:58:33.512958] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=6992) [2024-06-24 16:58:33.512996] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=6992) [2024-06-24 16:58:33.513030] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=17, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=344, avg_log_submit_to_slide_time=355) [2024-06-24 16:58:33.519517] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E927-0-0] [lt=28] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:33.519689] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E927-0-0] [lt=35][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:33.520235] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219513520029000, start_id=1719219513520029000, end_id=1719219513520029001) [2024-06-24 16:58:33.527267] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=20] start to print blacklist info [2024-06-24 16:58:33.527454] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=28] ls blacklist refresh finish(cost_time=11795) [2024-06-24 16:58:33.529947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:33.535425] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1719219513535422, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-06-24 16:58:33.547472] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513546464000, start_id=1719219513546464000, end_id=1719219513546464001) [2024-06-24 16:58:33.550523] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13724, offset=3446750}, end_cursor:ObLogCursor{file_id=1, log_id=13725, offset=3447023}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c2c050, len:2082, log_data_len:273, seq:13724, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:33.552209] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.552702] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D908-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219513551752000, start_id=1719219513551752000, end_id=1719219513551752001) [2024-06-24 16:58:33.552759] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D908-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7884, avg_group_log_size=606) [2024-06-24 16:58:33.552776] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D908-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7884) [2024-06-24 16:58:33.553081] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7884) [2024-06-24 16:58:33.553110] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=8] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7884) [2024-06-24 16:58:33.553134] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=366, avg_log_submit_to_slide_time=373) [2024-06-24 16:58:33.553717] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=22] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13725, offset=3447023}, end_cursor:ObLogCursor{file_id=1, log_id=13726, offset=3447288}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c30050, len:1809, log_data_len:265, seq:13725, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:33.559219] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219513559149000, start_id=1719219513559149000, end_id=1719219513559149001) [2024-06-24 16:58:33.559717] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=7] [APPLY STAT CB APPEND COST TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=31, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:33.559737] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=552, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:33.559747] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=9] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:33.559754] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=6] [APPLY STAT CB EXECUTE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-535, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:33.559761] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=6] [APPLY STAT CB TOTAL TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=47, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:33.576802] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.579542] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D424-0-0] [lt=36] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:33.584525] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513584511000, start_id=1719219513584511000, end_id=1719219513584511001) [2024-06-24 16:58:33.596981] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9615A-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.599432] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9615B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.603815] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9615E-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.606281] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9615F-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.606726] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513606718000, start_id=1719219513606718000, end_id=1719219513606718001) [2024-06-24 16:58:33.607328] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:33.608726] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96160-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.619879] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:33.620651] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:33.627071] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96169-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.629227] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616A-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.632649] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616C-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.634620] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:33.634721] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:33.634872] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:33.634924] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:33.635051] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:33.635111] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:33.635191] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9616F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:33.641093] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96170-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.652223] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.663147] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=421, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:33.663158] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1332) [2024-06-24 16:58:33.663179] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1332) [2024-06-24 16:58:33.663203] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:33.663216] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:33.663236] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=487, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:33.663247] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=9] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=17, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:33.664916] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=12] Garbage Collector is running(seq_=617, gc_interval=10000000) [2024-06-24 16:58:33.664996] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=33] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:33.665019] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=17] self is leader, skip it(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:33.665044] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=12] gc_check_member_list_ cost time(ret=0, time_us=92) [2024-06-24 16:58:33.665066] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=16] execute_gc cost time(ret=0, time_us=0) [2024-06-24 16:58:33.666827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283419176960, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:33.667007] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:33.668825] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=30] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:33.668861] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=31] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:33.668885] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:33.668903] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=43) [2024-06-24 16:58:33.668917] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:33.669649] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9617E-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.671937] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9617F-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.676861] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.699640] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=30] gc stale ls task succ [2024-06-24 16:58:33.702666] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=58] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:33.706914] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=26] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:33.708040] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=23] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:33.708109] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=19] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506800618000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:33.710179] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96192-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.720190] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219513719705000, start_id=1719219513719705000, end_id=1719219513719705001) [2024-06-24 16:58:33.720355] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=14] ====== tenant freeze timer task ====== [2024-06-24 16:58:33.720575] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [162333][Blacklist][T0][Y0-0000000000000000-0-0] [lt=22] blacklist_loop exec finished(cost_time=47, is_enabled=true, send_cnt=0) [2024-06-24 16:58:33.721951] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:33.721976] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:33.722007] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=103038476, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:33.722744] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D43A-0-0] [lt=24] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:33.722946] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=26268, mem_used=120625152) [2024-06-24 16:58:33.727647] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=14] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:33.729473] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:33.729573] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219507115876000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:33.729805] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=20] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:33.730042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:33.732098] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2EDA-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513731290000, start_id=1719219513731290000, end_id=1719219513731290001) [2024-06-24 16:58:33.732107] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C56-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219513731290000, start_id=1719219513731290001, end_id=1719219513731290002) [2024-06-24 16:58:33.732117] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD80B-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219513731290000, start_id=1719219513731290002, end_id=1719219513731290003) [2024-06-24 16:58:33.742016] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C66-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:33.742492] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C66-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:33.747236] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E13858-0-0] [lt=31] adaptive update(Tenant ID=1003, Config Specify Resource Limit(MB)=819, TxShare Current Memory Limit(MB)=668, Holding Memory(MB)=49, Tenant Remain Memory(MB)=1032, Usable Remain Memory(MB)=619, Last Update Limit Timestamp=1719219513747071, Is Updated=true) [2024-06-24 16:58:33.747444] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219513747071000, start_id=1719219513747071000, end_id=1719219513747071001) [2024-06-24 16:58:33.747513] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:33.747546] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:33.747900] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=339, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:33.747927] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:33.747958] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:33.747985] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=399, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:33.748005] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=27, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:33.752282] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.752971] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C70-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:33.753436] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C70-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:33.759300] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219513758628000, start_id=1719219513758628000, end_id=1719219513758628001) [2024-06-24 16:58:33.761239] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C73-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=152, pos=134, bitmap=NULL) [2024-06-24 16:58:33.761972] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C73-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:33.762228] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C73-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:33.762732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C73-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:33.763184] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C73-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:33.763312] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=8] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1332) [2024-06-24 16:58:33.763338] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=474, avg_log_submit_to_slide_time=480) [2024-06-24 16:58:33.763458] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256C73-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:33.765853] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494463, support_ssl=false) [2024-06-24 16:58:33.765906] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] sm conn init succ(conn.sessid_=3221494463, sess.client_addr_="172.20.17.86:49502") [2024-06-24 16:58:33.765922] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=11] accept one succ(*s={this:0x7f46bf5f6d70, session_id:3221494463, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:33.766003] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6d70, session_id:3221494463, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:33.766025] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=16] kill and revert session(conn.sessid_=3221494463, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:33.766036] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=10] sock ref clean, do destroy(*s={this:0x7f46bf5f6d70, session_id:3221494463, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:33.766052] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=14] mark session id unused(conn.sessid_=3221494463) [2024-06-24 16:58:33.766059] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162492][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=5] connection close(sessid=3221494463, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:33.771498] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1201) [2024-06-24 16:58:33.776919] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.784604] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513783936000, start_id=1719219513783936000, end_id=1719219513783936001) [2024-06-24 16:58:33.785023] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7764) [2024-06-24 16:58:33.806761] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219513806072000, start_id=1719219513806072000, end_id=1719219513806072001) [2024-06-24 16:58:33.823298] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961CE-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.824766] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=10] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=28, mem_used=49913856) [2024-06-24 16:58:33.824798] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=16] release old cannot free more memory [2024-06-24 16:58:33.824806] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=41, size_used=0, mem_used=49913856) [2024-06-24 16:58:33.826111] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCD895-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.829758] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961D1-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.831691] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961D2-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.833708] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961D3-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:33.836922] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219513836671000, start_id=1719219513836671000, end_id=1719219513836671001) [2024-06-24 16:58:33.851152] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961DB-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:33.852342] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:33.852382] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=39] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:33.852403] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.852921] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=36] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16477, offset=3753495}, end_cursor:ObLogCursor{file_id=1, log_id=16478, offset=3753768}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c34050, len:2537, log_data_len:273, seq:16477, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:33.853153] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961DC-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.854794] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F9-0-0] [lt=34][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:33.854820] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F9-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:33.855086] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F9-0-0] [lt=22] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334343862533569336e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.950271661537344414e+01) [2024-06-24 16:58:33.856191] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961DF-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.857145] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F9-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219513856746000, start_id=1719219513856746000, end_id=1719219513856746001) [2024-06-24 16:58:33.857240] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F9-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:33.857277] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8F9-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7764) [2024-06-24 16:58:33.857554] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=11] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:33.857608] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=363, avg_log_submit_to_slide_time=375) [2024-06-24 16:58:33.857970] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:33.858050] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:33.858182] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:33.858229] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:33.858241] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16478, offset=3753768}, end_cursor:ObLogCursor{file_id=1, log_id=16479, offset=3754033}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c38050, len:2264, log_data_len:265, seq:16478, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:33.858341] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:33.858394] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:33.858467] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E1-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:33.863734] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961E2-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:33.867326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283417079808, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:33.871058] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D6A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=287, pos=74, bitmap=NULL) [2024-06-24 16:58:33.871306] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D6A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:33.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.873668] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.873678] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874011] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874154] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874249] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=7] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874260] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874275] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874279] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874280] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874295] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874290] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874465] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874465] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874527] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874565] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=53] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874611] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874720] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874814] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.874873] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:33.875378] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D6D-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:33.876977] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.893384] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961F0-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:33.895366] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB961F1-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:33.905771] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219513905769, bytes: 170650734, bw: 0.019787 MB/s, add_ts: 1007618, add_bytes: 20906 [2024-06-24 16:58:33.911186] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:33.920431] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219513920099000, start_id=1719219513920099000, end_id=1719219513920099001) [2024-06-24 16:58:33.925668] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:33.925935] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:33.926037] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:33.926133] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:33.926300] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:33.926570] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:33.926698] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:33.926788] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:33.927045] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:33.927138] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:33.927293] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:33.927371] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:33.927585] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:33.927681] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:33.927761] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:33.927884] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:33.928084] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:33.928166] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:33.928242] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:33.928320] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:33.928446] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96201-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:33.928458] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:33.928536] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:33.928715] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:33.928810] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1256D7A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:33.930136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:33.947561] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219513947552000, start_id=1719219513947552000, end_id=1719219513947552001) [2024-06-24 16:58:33.948136] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=37] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:33.950573] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=22] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1004, avail_memory=773094113, chunk_count_=0, avail_sort_memory_=773094113, avail_memory_=773094113) [2024-06-24 16:58:33.952400] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.954679] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8B67-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219513953864000, start_id=1719219513953864000, end_id=1719219513953864001) [2024-06-24 16:58:33.959406] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219513959148000, start_id=1719219513959148000, end_id=1719219513959148001) [2024-06-24 16:58:33.962951] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:33.962988] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2024-06-24 16:58:33.963013] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1332) [2024-06-24 16:58:33.963033] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:33.963066] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2024-06-24 16:58:33.963366] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=363, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:33.971688] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C8B67-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=35, this=0x7f4753d24280, extra_info="") [2024-06-24 16:58:33.971711] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C8B67-0-0] [lt=22] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=391, this=0x7f4753d244b0, extra_info="") [2024-06-24 16:58:33.971722] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C8B67-0-0] [lt=10] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=0, this=0x7f4753d246e0, extra_info="") [2024-06-24 16:58:33.971731] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C8B67-0-0] [lt=8] [APPLY STAT CB EXECUTE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=-482, this=0x7f4753d24910, extra_info="") [2024-06-24 16:58:33.971742] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C8B67-0-0] [lt=11] [APPLY STAT CB TOTAL TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=-55, this=0x7f4753d24b40, extra_info="") [2024-06-24 16:58:33.977035] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:33.984703] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219513984457000, start_id=1719219513984457000, end_id=1719219513984457001) [2024-06-24 16:58:34.002506] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=27] gc stale ls task succ [2024-06-24 16:58:34.005778] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=30] log compressor cycles once. (ret=0, cost_time=1056, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261360152576) [2024-06-24 16:58:34.006154] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219514005571000, start_id=1719219514005571000, end_id=1719219514005571001) [2024-06-24 16:58:34.029705] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 605.50) [2024-06-24 16:58:34.029720] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:34.029784] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 378.50) [2024-06-24 16:58:34.029793] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:34.029809] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029818] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029824] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029829] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029835] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029842] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029847] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029859] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029865] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029873] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029878] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029884] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029897] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029902] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=4] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.029910] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:34.033977] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9623A-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.035819] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9623B-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.039188] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9623D-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.041111] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9623E-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.043033] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB44-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103410134399, cache_obj->added_lc()=false, cache_obj->get_object_id()=9354, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:34.044257] WDIAG get_refactored (ob_hashtable.h:1102) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB46-0-0] [lt=34][errcode=-4201] hashtable not init [2024-06-24 16:58:34.044278] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB46-0-0] [lt=19][errcode=-4016] get cursor info failed(cursor_id=1149, get_sessid()=3221489125) [2024-06-24 16:58:34.044280] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [703][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CB94CEE-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.044413] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC04-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219514043511000, start_id=1719219514043511000, end_id=1719219514043511001) [2024-06-24 16:58:34.052463] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.053917] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:34.061002] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96246-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.062830] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96247-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.063043] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1454) [2024-06-24 16:58:34.065673] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96249-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.067311] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:34.067388] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:34.067515] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:34.067561] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:34.067680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:34.067733] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:34.067801] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624B-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:34.067843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283414982656, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:34.068477] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash time detail, (compute_wash_size_time=169, refresh_score_time=136, wash_time=0) [2024-06-24 16:58:34.071315] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=87] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:34.071360] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:34.071390] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:34.071413] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:34.071721] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=292, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:34.071738] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=164, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:34.071729] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=351, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:34.071752] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=12, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:34.071765] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:34.071792] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=534, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:34.071812] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=23, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:34.071839] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:34.071853] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=417, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:34.071868] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=16, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:34.073462] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9624C-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4565, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.077092] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.094784] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=487, mem_used=2079744) [2024-06-24 16:58:34.096421] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096502] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096502] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096742] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096833] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096839] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.096995] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097014] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097102] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097104] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097196] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097237] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097245] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097333] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097487] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097601] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.097659] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098046] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098209] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098305] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098303] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96259-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.098526] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098687] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098690] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098685] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098695] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098698] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098704] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098701] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098705] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098767] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098770] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.098938] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.099052] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.099673] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.100079] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9625A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.103836] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:34.111195] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:34.111218] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:34.111251] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=73508492, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:34.112601] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163033][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1C-0-0] [lt=23] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:34.112648] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163033][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1C-0-0] [lt=39] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=56) [2024-06-24 16:58:34.120461] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219514120437000, start_id=1719219514120437000, end_id=1719219514120437001) [2024-06-24 16:58:34.130229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:34.131470] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9626D-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.133358] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:34.141011] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D6-0-0] [lt=16] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:34.141040] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D6-0-0] [lt=26] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:34.142481] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F1-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:34.142516] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F1-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:34.147693] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219514146795000, start_id=1719219514146795000, end_id=1719219514146795001) [2024-06-24 16:58:34.152526] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.159500] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514159483000, start_id=1719219514159483000, end_id=1719219514159483001) [2024-06-24 16:58:34.163484] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:34.163507] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:34.163524] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=399, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:34.163538] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=20, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:34.171414] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1323, avg_group_log_size=120) [2024-06-24 16:58:34.171444] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1323) [2024-06-24 16:58:34.171483] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=19, avg_log_batch_cnt=1, total_group_log_size=10123, avg_group_log_size=532) [2024-06-24 16:58:34.171502] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=10123) [2024-06-24 16:58:34.171824] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1445) [2024-06-24 16:58:34.171858] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=398, avg_log_submit_to_slide_time=407) [2024-06-24 16:58:34.174841] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=23] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:34.177199] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:34.177228] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:34.177247] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.184850] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514183804000, start_id=1719219514183804000, end_id=1719219514183804001) [2024-06-24 16:58:34.201238] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:34.202151] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=39] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:34.206276] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219514205973000, start_id=1719219514205973000, end_id=1719219514205973001) [2024-06-24 16:58:34.231262] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A2-0-0] [lt=55][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:34.236983] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:34.237018] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4093, avg_group_log_size=372) [2024-06-24 16:58:34.237045] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4093) [2024-06-24 16:58:34.237065] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:34.237375] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=5] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4093) [2024-06-24 16:58:34.237419] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4093) [2024-06-24 16:58:34.237441] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=4, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:34.237453] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=386, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:34.237461] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=16, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:34.238704] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962A9-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.241249] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962AA-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.249860] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962AC-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.252474] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962AD-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.252585] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.254916] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962AE-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.268983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283412885504, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:34.274906] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962B5-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.277209] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.277501] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962B6-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.277510] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=27] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:34.277532] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C725-0-0] [lt=21] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:34.277550] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=39] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:34.277565] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C725-0-0] [lt=29] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:34.281295] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962B8-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.283274] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:34.283373] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:34.283547] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:34.283610] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:34.283769] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:34.283837] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:34.283926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BA-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:34.289148] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:34.289262] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=51] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:34.289291] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:34.289365] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1627545600, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5888647168, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:34.289522] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=36] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:34.289542] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=416254, drift_size_=0, pre_drift_size=42840784, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:34.289653] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:34.289779] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:34.289799] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:34.289866] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:34.289899] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962BB-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.289989] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=27] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:34.290013] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:34.320543] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219514319974000, start_id=1719219514319974000, end_id=1719219514319974001) [2024-06-24 16:58:34.321015] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=366, avg_log_submit_to_slide_time=374) [2024-06-24 16:58:34.321894] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962CA-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.324676] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB962CB-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.325368] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111665, mem_used=262047744) [2024-06-24 16:58:34.330321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:34.337757] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219514336865000, start_id=1719219514336865000, end_id=1719219514336865001) [2024-06-24 16:58:34.337799] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:34.342139] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=29] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:34.347785] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219514347435000, start_id=1719219514347435000, end_id=1719219514347435001) [2024-06-24 16:58:34.352635] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.358242] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257002-0-0] [lt=16] refresh tenant config success(tenant_id=1002, *this={last_refresh_ts:1719219514357962, can_tenant_elr:true}) [2024-06-24 16:58:34.359678] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219514359018000, start_id=1719219514359018000, end_id=1719219514359018001) [2024-06-24 16:58:34.359753] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:34.359787] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:34.360288] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219513953864001, v:0}, new_max_version={val:1719219513953864001, v:0}, last_min_version={val:1719219513836671000, v:0}, last_max_version={val:1719219513836671000, v:0}, total_time_us=2570, delta_us=406422) [2024-06-24 16:58:34.360318] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219513953864001, v:0}, min_version={val:1719219513953864001, v:0}, max_version={val:1719219513953864001, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:34.363261] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:34.363292] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:34.367602] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD055-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.377264] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.384961] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514384350000, start_id=1719219514384350000, end_id=1719219514384350001) [2024-06-24 16:58:34.387378] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [162299][AutoLSLocRpc][T0][YB42AC141156-00061B9D89F0D94F-0-0] [lt=107] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["172.20.17.86:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1003, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1004, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1004, ls_id:{id:1001}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}]) [2024-06-24 16:58:34.407085] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219514406516000, start_id=1719219514406516000, end_id=1719219514406516001) [2024-06-24 16:58:34.407489] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=333, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:34.407507] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:34.407530] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:34.407555] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=386, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:34.407572] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=23, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:34.408506] INFO [CLOG] update_upstream (ob_remote_location_adaptor.cpp:91) [163823][T1002_LogRessvr][T1002][YB42AC141156-00061B9D8CA0C0E5-0-0] [lt=29] primary tenant, just skip [2024-06-24 16:58:34.419805] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129657, mem_used=326519808) [2024-06-24 16:58:34.431310] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:34.433485] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:34.433531] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=44] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:34.433583] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=44] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:34.433738] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:34.433866] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=123] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:34.433896] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:34.433919] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219511204349001, v:0}) [2024-06-24 16:58:34.433933] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:34.433946] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:34.433964] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:34.433993] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:34.434019] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:34.434036] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:34.452694] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.458410] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=35] ====== tenant freeze timer task ====== [2024-06-24 16:58:34.463667] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:34.463721] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=404, avg_log_submit_to_slide_time=412) [2024-06-24 16:58:34.469479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283410788352, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:34.477320] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.477959] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=52] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:34.480184] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:34.504963] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:34.510012] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96317-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.510680] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB47-0-0] [lt=18][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103410602051, cache_obj->added_lc()=false, cache_obj->get_object_id()=9355, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:34.512900] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96318-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.518381] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9631A-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.520568] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219514520543000, start_id=1719219514520543000, end_id=1719219514520543001) [2024-06-24 16:58:34.521150] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9631B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.521393] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=376, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:34.521414] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:34.523990] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9631C-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.528285] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2F0F-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219514527939000, start_id=1719219514527939000, end_id=1719219514527939001) [2024-06-24 16:58:34.528707] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=6649) [2024-06-24 16:58:34.528747] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=6649) [2024-06-24 16:58:34.528792] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=31, avg_log_gen_to_submit_time=39, avg_log_submit_to_flush_time=565, avg_log_submit_to_slide_time=577) [2024-06-24 16:58:34.530417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:34.530712] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8B7E-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219514530053000, start_id=1719219514530053000, end_id=1719219514530053001) [2024-06-24 16:58:34.534667] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1192][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=47] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:34.538232] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82036-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219514537448000, start_id=1719219514537448000, end_id=1719219514537448001) [2024-06-24 16:58:34.543041] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1719219514543038, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-06-24 16:58:34.547927] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219514546951000, start_id=1719219514546951000, end_id=1719219514546951001) [2024-06-24 16:58:34.551420] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96324-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.552758] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.554015] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96325-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.556705] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=17] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13726, offset=3447288}, end_cursor:ObLogCursor{file_id=1, log_id=13727, offset=3447561}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c3c050, len:1544, log_data_len:273, seq:13726, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:34.557934] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96327-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.558879] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D909-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219514558570000, start_id=1719219514558570000, end_id=1719219514558570001) [2024-06-24 16:58:34.558937] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D909-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7774, avg_group_log_size=647) [2024-06-24 16:58:34.558959] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D909-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7774) [2024-06-24 16:58:34.559287] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=9] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7774) [2024-06-24 16:58:34.559319] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7774) [2024-06-24 16:58:34.559360] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=369, avg_log_submit_to_slide_time=381) [2024-06-24 16:58:34.559635] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219514558570000, start_id=1719219514558570001, end_id=1719219514558570002) [2024-06-24 16:58:34.559871] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13727, offset=3447561}, end_cursor:ObLogCursor{file_id=1, log_id=13728, offset=3447826}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c40050, len:1271, log_data_len:265, seq:13727, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:34.560710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:34.560802] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:34.560968] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:34.561023] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:34.561163] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:34.561227] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:34.561310] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96328-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:34.573283] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EF8C-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.577375] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.585098] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514584987000, start_id=1719219514584987000, end_id=1719219514584987001) [2024-06-24 16:58:34.602378] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:34.605640] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:34.605768] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=127] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:34.605787] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=16] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:34.605861] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=74] get_replay_process success(id={id:1001}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:34.605921] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=14] dump tenant replay process(tenant_id=1002, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:34.607207] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219514607185000, start_id=1719219514607185000, end_id=1719219514607185001) [2024-06-24 16:58:34.608108] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96335-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.610641] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96336-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.611469] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1293][T1004_TntTransf][T1004][YB42AC141156-00061B9D97D0C34C-0-0] [lt=33] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:34.611570] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1296][T1004_TntTransf][T1004][YB42AC141156-00061B9D9800C34C-0-0] [lt=28] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:34.619990] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:34.620712] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:34.628514] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [163827][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:34.628657] WDIAG read_multi_row (ob_table_access_helper.h:238) [163827][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:34.629003] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:221) [163827][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:34.641503] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDE9E-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:34.642546] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073B4A-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219514642062000, start_id=1719219514642062000, end_id=1719219514642062001) [2024-06-24 16:58:34.650810] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A2F30-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219514650522000, start_id=1719219514650522000, end_id=1719219514650522001) [2024-06-24 16:58:34.652818] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.655541] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9634A-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.661640] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD50-0-0] [lt=27] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:34.662686] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [1391][T1004_MediumLoo][T1004][YB42AC141156-00061B9D98C0C24B-0-0] [lt=34] MediumCheckTask(cost_ts=35) [2024-06-24 16:58:34.663774] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=356, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:34.663796] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:34.663810] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:34.663799] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:34.663851] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:34.663875] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=423, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:34.663891] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=20, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:34.670015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283412885504, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:34.677430] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.684795] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1294][T1004_TntTransf][T1004][YB42AC141156-00061B9D97E0C34C-0-0] [lt=33] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:34.693359] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=25] LogLoopThread round_cost_time(us)(round_cost_time=21) [2024-06-24 16:58:34.699703] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:34.716405] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:34.716449] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=24] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1238) [2024-06-24 16:58:34.721260] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219514721148000, start_id=1719219514721148000, end_id=1719219514721148001) [2024-06-24 16:58:34.723083] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=30615, mem_used=131023872) [2024-06-24 16:58:34.728072] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1295][T1004_TntTransf][T1004][YB42AC141156-00061B9D97F0C34C-0-0] [lt=31] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:34.729881] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=16] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:34.730509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:34.731235] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA125723E-0-0] [lt=15][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:34.748018] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514747565000, start_id=1719219514747565000, end_id=1719219514747565001) [2024-06-24 16:58:34.748095] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:34.748129] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:34.748462] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=313, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:34.748487] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:34.748519] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:34.748545] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=373, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:34.748563] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=30, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:34.752880] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.759876] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219514759220000, start_id=1719219514759220000, end_id=1719219514759220001) [2024-06-24 16:58:34.762648] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [163826][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=32] report RowHolderMapper summary info(count=2620, bkt_cnt=7851) [2024-06-24 16:58:34.763843] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:34.763882] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=386, avg_log_submit_to_slide_time=395) [2024-06-24 16:58:34.765136] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221494464, support_ssl=false) [2024-06-24 16:58:34.765213] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=30] sm conn init succ(conn.sessid_=3221494464, sess.client_addr_="172.20.17.86:49504") [2024-06-24 16:58:34.765236] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f46bf5f6030, session_id:3221494464, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:34.765307] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6030, session_id:3221494464, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:34.765338] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494464, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:34.765354] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f46bf5f6030, session_id:3221494464, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:34.765378] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494464) [2024-06-24 16:58:34.765391] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162506][sql_nio16][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494464, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:34.770349] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=15] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:34.770380] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=22] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:34.770401] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=18] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:34.770416] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=13] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1217) [2024-06-24 16:58:34.772096] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:34.777485] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.785202] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219514784620000, start_id=1719219514784620000, end_id=1719219514784620001) [2024-06-24 16:58:34.793451] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:68033, max_lsn:45069961, max_scn:{val:1719219514337922005, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:45069961}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:3126921}}, last_submit_lsn:{lsn:45069839}, last_submit_end_lsn:{lsn:45069961}, last_submit_log_id:68033, last_submit_log_pid:1, max_flushed_lsn:{lsn:45069839}, max_flushed_end_lsn:{lsn:45069961}, max_flushed_log_pid:1, committed_end_lsn:{lsn:45069961}, last_slide_log_id:68033, last_slide_scn:{val:1719219514337922005, v:0}, last_slide_lsn:{lsn:45069839}, last_slide_end_lsn:{lsn:45069961}, last_slide_log_pid:1, last_slide_log_accum_checksum:1166505810, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d7a46530}, [StateMgr]={this:0x7f46d7a4a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:68034, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213363223619, palf_role_change_cb:0x7f46d7a50cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d7a47c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1/meta", dir_fd:685, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d7a4c478, flashback_version:0}, log_storage:{log_tail:{lsn:45069961}, readable_log_tail:{lsn:45069961}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1/log", dir_fd:686, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:22034807, block_header_serialize_buf_:0x7f46d7a4e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213363223315, this:0x7f46d7a4a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213363224198, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d7a4a430}) [2024-06-24 16:58:34.793847] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=391] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219514763837, last_flushed_end_lsn:{lsn:45069961}}]) [2024-06-24 16:58:34.793885] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=34] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=68034, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219514763837, last_flushed_end_lsn:{lsn:45069961}}]) [2024-06-24 16:58:34.794876] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96385-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.797557] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96386-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.802328] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96388-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.804838] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96389-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.807317] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219514806835000, start_id=1719219514806835000, end_id=1719219514806835001) [2024-06-24 16:58:34.807452] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9638A-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:34.807884] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:34.811311] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=10] ====== check clog disk timer task ====== [2024-06-24 16:58:34.811331] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=13] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=114) [2024-06-24 16:58:34.811352] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=11] cannot_recycle_log_size statistics(cannot_recycle_log_size=53453982, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:34.824897] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=12] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=24, mem_used=49913856) [2024-06-24 16:58:34.824917] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] release old cannot free more memory [2024-06-24 16:58:34.824922] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=4] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=25, size_used=0, mem_used=49913856) [2024-06-24 16:58:34.829919] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96392-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:34.832644] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96393-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.836843] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96395-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.838587] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219514838441000, start_id=1719219514838441000, end_id=1719219514838441001) [2024-06-24 16:58:34.839642] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:34.839733] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:34.839893] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:34.839946] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:34.840077] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:34.840140] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:34.840222] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96397-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:34.852670] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96398-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:34.852939] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.854511] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=20] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:34.854581] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=69] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:34.854604] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=6] dump tenant replay process(tenant_id=1001, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:34.856247] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=24] current monitor number(seq_=-1) [2024-06-24 16:58:34.858034] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] get_max_applied_scn(scn={val:1719219514670604000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:517641707}, palf_committed_end_scn_:{val:1719219514670604001, v:0}, last_check_scn_:{val:1719219514670604001, v:0}, max_applied_cb_scn_:{val:1719219514670604000, v:0}}) [2024-06-24 16:58:34.862222] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16479, offset=3754033}, end_cursor:ObLogCursor{file_id=1, log_id=16480, offset=3754306}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c44050, len:1999, log_data_len:273, seq:16479, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:34.864135] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FA-0-0] [lt=35][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:34.864161] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FA-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:34.864409] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FA-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334343862533569336e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.950271661537344414e+01) [2024-06-24 16:58:34.866181] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:463) [1215][T1004_TeRec][T1004][YB42AC141156-00061B9D9330D8FA-0-0] [lt=42] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1719219513336076005, v:0}, new_replayable_scn={val:1719219513336076005, v:0}, new_readable_scn={val:1719219513336076005, v:0}, old_tenant_info={tenant_id:1004, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719219512334503004, v:0}, replayable_scn:{val:1719219512334503004, v:0}, standby_scn:{val:1719219512334503004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1001}}) [2024-06-24 16:58:34.866581] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FA-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219514865857000, start_id=1719219514865857000, end_id=1719219514865857001) [2024-06-24 16:58:34.866683] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FA-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:34.866711] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FA-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7764) [2024-06-24 16:58:34.866983] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=11] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:34.867024] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8889) [2024-06-24 16:58:34.867056] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=343, avg_log_submit_to_slide_time=355) [2024-06-24 16:58:34.867689] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=33] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16480, offset=3754306}, end_cursor:ObLogCursor{file_id=1, log_id=16481, offset=3754571}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c48050, len:1726, log_data_len:265, seq:16480, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:34.870509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283410788352, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:34.873446] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.873648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.873891] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.873901] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.873928] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874038] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874047] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874104] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874257] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874255] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874281] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874288] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874292] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874305] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874311] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874507] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874510] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874515] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874538] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874579] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874678] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=7] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874680] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.874685] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:34.877540] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.885934] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963A5-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:34.888516] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963A6-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:34.892032] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=16911384, clean_num=201326) [2024-06-24 16:58:34.906069] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=33] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:34.911251] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:34.913386] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1719219514913384, bytes: 170671789, bw: 0.019928 MB/s, add_ts: 1007615, add_bytes: 21055 [2024-06-24 16:58:34.921331] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514920772000, start_id=1719219514920772000, end_id=1719219514920772001) [2024-06-24 16:58:34.930603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:34.934219] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963BA-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:34.946360] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [941][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:34.946481] WDIAG read_multi_row (ob_table_access_helper.h:238) [941][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=37][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:34.948105] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219514947201000, start_id=1719219514947201000, end_id=1719219514947201001) [2024-06-24 16:58:34.952998] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.953495] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=17] ====== tenant freeze timer task ====== [2024-06-24 16:58:34.960006] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219514959885000, start_id=1719219514959885000, end_id=1719219514959885001) [2024-06-24 16:58:34.963656] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:34.963693] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:34.963717] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:34.963737] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:34.963770] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:34.964251] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=353, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:34.977596] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:34.985322] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219514985220000, start_id=1719219514985220000, end_id=1719219514985220001) [2024-06-24 16:58:35.002572] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:35.007440] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219515007417000, start_id=1719219515007417000, end_id=1719219515007417001) [2024-06-24 16:58:35.011212] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:35.011251] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=26] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1238) [2024-06-24 16:58:35.025463] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [917][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=20] dump dtl interm result cost(us)(dump_cost=6, ret=0, interm count=0, dump count=619) [2024-06-24 16:58:35.025496] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [917][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=28] clear dtl interm result cost(us)(clear_cost=3, ret=0, gc_.expire_keys_.count()=0, dump count=619, interm count=0, clean count=0) [2024-06-24 16:58:35.031058] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 366.00) [2024-06-24 16:58:35.031076] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:35.031136] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 368.00) [2024-06-24 16:58:35.031144] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:35.031161] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031171] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031177] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031184] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031189] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031194] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031201] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031208] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031214] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031220] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031233] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031239] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031246] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031251] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.031260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:35.035272] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:35.035300] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:35.035337] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=348755186, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:35.053057] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.054045] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:35.063673] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] tx gc loop thread is running(MTL_ID()=1004) [2024-06-24 16:58:35.063696] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] try gc retain ctx [2024-06-24 16:58:35.063743] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=12] get_max_applied_scn(scn={val:1719219514838441001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:45070205}, palf_committed_end_scn_:{val:1719219514838441001, v:0}, last_check_scn_:{val:1719219514838441001, v:0}, max_applied_cb_scn_:{val:1719219514838441001, v:0}}) [2024-06-24 16:58:35.063781] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=30] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:35.066330] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=95] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219512334503004, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:35.068045] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=23] LogLoopThread round_cost_time(us)(round_cost_time=14) [2024-06-24 16:58:35.068973] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=108] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219512334503004, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:35.069091] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=87] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:35.071911] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:35.071949] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:35.071977] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:35.071999] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:35.072278] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=327, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:35.072278] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=346, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:35.072304] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:35.072305] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:35.072337] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:35.072366] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=381, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:35.072386] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=20, stat_interval=1000000, avg (count/cost)=21, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:35.072415] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:35.072429] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=425, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:35.072443] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=21, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:35.077630] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.078893] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963F5-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.081538] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963F6-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.086307] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963F8-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.089376] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A3250-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.092001] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB963F9-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.092514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283410788352, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:35.094914] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=522, mem_used=2079744) [2024-06-24 16:58:35.095923] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096065] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096749] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.096756] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097063] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097086] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097094] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097205] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097243] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097281] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097515] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097520] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097562] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097789] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097829] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097870] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097965] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.097968] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098036] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098035] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098097] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098212] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098229] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098236] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098327] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098331] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098471] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098536] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098558] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098642] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098682] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098686] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.098710] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.099645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.113012] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96401-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.115696] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96402-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:35.117509] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=11] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:35.117555] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=23] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:35.117577] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=18] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:35.117592] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=12] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1230) [2024-06-24 16:58:35.119606] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96404-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:35.121268] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [162968][T1_TenantWeakRe][T1][YB42AC141156-00061B9D89B13943-0-0] [lt=31] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=194) [2024-06-24 16:58:35.121474] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219515121461000, start_id=1719219515121461000, end_id=1719219515121461001) [2024-06-24 16:58:35.122215] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:35.122307] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:35.122469] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:35.122524] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:35.122670] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:35.122734] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:35.122817] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96406-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:35.133472] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:35.134995] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96407-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.142502] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D7-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:35.142530] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D7-0-0] [lt=26] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:35.143030] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82000000, replace_num=100000) [2024-06-24 16:58:35.143063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:35.144407] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F2-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:35.144442] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F2-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:35.148317] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219515147883000, start_id=1719219515147883000, end_id=1719219515147883001) [2024-06-24 16:58:35.153117] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.157525] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219515157395000, start_id=1719219515157395000, end_id=1719219515157395001) [2024-06-24 16:58:35.157763] WDIAG [STORAGE.TRANS] check_double_insert_ (ob_mvcc_row.cpp:930) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=25][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f4733963a00 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:81910} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1719215152848208 type=0 flag=0 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:4}, prev=this=0x7f46b77eab40 trans_version={val:1719219505153320000, v:0} scn={val:1719219505153320000, v:0} tx_id={txid:81805} prev=0x7f46b77ea9f0 next=(nil) modify_count=871 acc_checksum=1016148195 version=1719215152848208 type=0 flag=12 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:7}, snapshot_version={val:1719219515157395000, v:0}, *this={this=0x7f47339376b0 latch_=locked flag=11 first_dml=DELETE last_dml=INSERT update_since_compact=2 list_head=0x7f46b77eab40 latest_compact_node=0x7f46b77ea5d8 max_trans_version={val:1719219505153320000, v:0} max_trans_id=81805 max_elr_trans_version={val:1719219505153320000, v:0} max_elr_trans_id=81805 latest_compact_ts=1719219495072405 last_compact_cnt=869 total_trans_node_cnt=872 max_modify_scn={val:1719219505153320000, v:0} min_modify_scn={val:1719215152848421000, v:0}}) [2024-06-24 16:58:35.157845] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:972) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=81][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f4733963a00 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:81910} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1719215152848208 type=0 flag=0 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:4}, ctx={this:0x7f4765bc8e80, ls_id:{id:1001}, ls:0x7f47366f8150, branch:0, timeout:1719219525057406, tablet_id:{id:200142}, table_iter:0x7f4765bc8150, table_version:1719213404545896, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1719219525057406, tx_lock_timeout_us:-1, snapshot:{version:{val:1719219515157395000, v:0}, tx_id:{txid:81910}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f4736706990, epoch:1, mini_cache_:}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:81910}, tx_desc:{this:0x7f47694ef070, tx_id:{txid:81910}, state:1, addr:"172.20.17.86:2882", tenant_id:1002, session_id:3221487822, assoc_session_id:3221487822, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1719219515156339, active_ts:1719219515157395, commit_ts:-1, finish_ts:-1, timeout_us:86400000000, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1719213093, cluster_version:17180066048, seq_base:1719219515095033, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:true, cflict_txs:[], abort_cause:0, commit_expire_ts:-1, commit_task_.is_registered():false, ref:2}, tx_ctx:0x7f47a7f52550, mem_ctx:0x7f47a7f53ad0, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false}) [2024-06-24 16:58:35.157988] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:339) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=141][errcode=-5024] mvcc write failed(ret=-5024, mem_ctx={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:81910} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}, arg={tx_id:{txid:81910}, data:0x7f4765bc5238, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1719215152848208, seq_no:{branch:0, seq:4}, scn:{val:4611686018427387903, v:0}, column_cnt:8}) [2024-06-24 16:58:35.158036] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:323) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=47][errcode=0] primary key duplication conflict(key={"VARCHAR":"172.20.17.86:5433", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:81910} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2024-06-24 16:58:35.158075] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:3838) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=36][errcode=-5024] fail to set memtable(ret=-5024) [2024-06-24 16:58:35.158093] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5375) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=14][errcode=-5024] failed to write table row(ret=-5024, table id=500310, col_descs=[cnt:8, column_id=16 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=17 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=18 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=19 {type:"TINYINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"TINYINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"DATETIME", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"DATETIME", collation:"binary", coercibility:"NUMERIC"} order=0], tbl_row={flag:"INSERT", flag_type:0} capacity_=0 is_get=0 from_base=0 trans_id=8217090173679840641 scan_index=0 multi_version_row_flag=0 {first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0} row_val={count=8,cells=[{"VARCHAR":"172.20.17.86:5433", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"VARCHAR":"7513a2bb6f", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"VARCHAR":"265c81f5a4bed7cc05ac37c8bcf81170d86650be6b28644a344f4f45f2dd7aa7", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"TINYINT":1},{"TINYINT":0},{"VARCHAR":"4.3.0-20240617185317", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"DATETIME":"2024-06-24 16:58:35.000000"},{"DATETIME":"2024-06-24 16:58:35.000000"},] is_sparse_row=0 snapshot_version=0 fast_filtered=0 group_idx_=0 last_purge_ts=0 ) [2024-06-24 16:58:35.158211] INFO [STORAGE] print_count (ob_query_iterator_factory.cpp:50) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=87] ObQueryIteratorFactory statistics(multi_scan_merge_alloc_count=0, multi_scan_merge_release_count=0, multi_get_merge_alloc_count=0, multi_get_merge_release_count=0, table_scan_alloc_count=0, table_scan_release_count=0, insert_dup_alloc_count=8920, insert_dup_release_count=8920, col_map_alloc_count=0, col_map_release_count=0) [2024-06-24 16:58:35.158246] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:2923) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=24][errcode=-5024] failed to write row(ret=-5024) [2024-06-24 16:58:35.158299] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:851) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BAE-0-0] [lt=13] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:81910} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-06-24 16:58:35.160092] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219515159510000, start_id=1719219515159510000, end_id=1719219515159510001) [2024-06-24 16:58:35.164081] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:35.164108] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:35.164136] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=413, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:35.164154] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=22, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:35.171937] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:35.171961] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:35.172292] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:35.172327] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=395, avg_log_submit_to_slide_time=404) [2024-06-24 16:58:35.174572] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96414-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:35.174936] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=25] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:35.177124] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96415-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.177686] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.185546] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219515184884000, start_id=1719219515184884000, end_id=1719219515184884001) [2024-06-24 16:58:35.201298] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:35.203342] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [162977][T1_ArcSender][T1][YB42AC141156-00061B9D8760C0E5-0-0] [lt=24][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:35.207579] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219515207031000, start_id=1719219515207031000, end_id=1719219515207031001) [2024-06-24 16:58:35.219967] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [939][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=2620, bkt_cnt=7836) [2024-06-24 16:58:35.222687] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96427-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:35.223810] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [803][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=45] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:35.236056] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2024-06-24 16:58:35.236102] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=17] get_max_applied_scn(scn={val:1719219515147883000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:73517434}, palf_committed_end_scn_:{val:1719219515184884000, v:0}, last_check_scn_:{val:1719219515184884000, v:0}, max_applied_cb_scn_:{val:1719219515147883000, v:0}}) [2024-06-24 16:58:35.236136] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=30] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:35.237577] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:35.237608] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:35.237938] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3412) [2024-06-24 16:58:35.237975] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3412) [2024-06-24 16:58:35.238022] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:35.238043] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=426, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:35.238061] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=30, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:35.238337] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=95] succ to get rec scn(*this={this:0x7f46f0604030, ls_id:{id:1}, tenant_id:1003, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216321111181000, v:0}, last_push_gc_task_ts_:1719216953731290, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:35.238374] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=36] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46f1df0080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216953736744, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46f1df0080, snapshot_version:{val:1719216953736744, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:35.238416] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=35] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:35.238565] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=24] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:35.238690] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=120] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46f1d8d790}, min_rec_scn={val:1719216953754927000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:35.238720] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:35.238742] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219507943313001, v:0}) [2024-06-24 16:58:35.238756] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:35.238770] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:35.238786] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=9] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216953754927000, v:0}, checkpoint_scn_in_ls_meta={val:1719216953754927000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:35.238816] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:35.238841] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:35.238857] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:35.242020] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A3-0-0] [lt=49][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:35.253030] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:35.253060] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=19] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:35.253078] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=15] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1237) [2024-06-24 16:58:35.253175] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.271467] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=96] tx gc loop thread is running(MTL_ID()=1003) [2024-06-24 16:58:35.271501] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=32] try gc retain ctx [2024-06-24 16:58:35.272011] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=21, avg_log_batch_cnt=1, total_group_log_size=9957, avg_group_log_size=474) [2024-06-24 16:58:35.272043] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9957) [2024-06-24 16:58:35.274737] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=21] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1003, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:35.277740] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.284876] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=25] dump dtl interm result cost(us)(dump_cost=2348, ret=0, interm count=0, dump count=616) [2024-06-24 16:58:35.286886] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=21] clear dtl interm result cost(us)(clear_cost=1988, ret=0, gc_.expire_keys_.count()=0, dump count=616, interm count=0, clean count=0) [2024-06-24 16:58:35.293016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283402399744, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:35.300600] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:35.300643] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=35] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:35.300682] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=24] cannot_recycle_log_size statistics(cannot_recycle_log_size=70269286, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:35.305113] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [348][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=9] ====== traversal_flush timer task ====== [2024-06-24 16:58:35.305304] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BA-0-0] [lt=21] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219512507320000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:35.305491] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BA-0-0] [lt=122] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219512507320000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:35.305616] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BA-0-0] [lt=114] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:35.307316] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=39] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:35.315406] INFO [STORAGE] runTimerTask (ob_ddl_heart_beat_task.cpp:49) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=21] send to rs all task status succeed [2024-06-24 16:58:35.321581] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219515321038000, start_id=1719219515321038000, end_id=1719219515321038001) [2024-06-24 16:58:35.321686] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3997, avg_group_log_size=399) [2024-06-24 16:58:35.321715] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3534) [2024-06-24 16:58:35.322458] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=436, avg_log_submit_to_slide_time=451) [2024-06-24 16:58:35.323484] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:35.325489] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=111700, mem_used=262047744) [2024-06-24 16:58:35.331881] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:397) [162151][ServerTracerTim][T0][YB42AC141156-00061B9D86E0C5CA-0-0] [lt=17] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-06-24 16:58:35.333383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A3448-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219515332677000, start_id=1719219515332677000, end_id=1719219515332677001) [2024-06-24 16:58:35.333473] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257248-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219515332677000, start_id=1719219515332677001, end_id=1719219515332677002) [2024-06-24 16:58:35.339134] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BBE-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219515339023000, start_id=1719219515339023000, end_id=1719219515339023001) [2024-06-24 16:58:35.339423] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1719219515339023000, start_id=1719219515339023000, end_id=1719219515339023001) [2024-06-24 16:58:35.339464] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:35.339909] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=18] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219515339883], gts:1719219515339023000, latest_srr:[mts=1719219515339883]}) [2024-06-24 16:58:35.342267] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:35.343150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:35.348366] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219515347478000, start_id=1719219515347478000, end_id=1719219515347478001) [2024-06-24 16:58:35.348969] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [WRS] update tenant weak read server version(tenant_id=1003, server_version={version:{val:1719219515184884000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1719219515348940}, version_delta=164084) [2024-06-24 16:58:35.353238] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.360229] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219515360168000, start_id=1719219515360168000, end_id=1719219515360168001) [2024-06-24 16:58:35.360307] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:35.360340] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:35.360658] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96463-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.360807] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219514838441002, v:0}, new_max_version={val:1719219514838441002, v:0}, last_min_version={val:1719219514838441000, v:0}, last_max_version={val:1719219514838441000, v:0}, total_time_us=2492, delta_us=522364) [2024-06-24 16:58:35.360836] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219514838441002, v:0}, min_version={val:1719219514838441002, v:0}, max_version={val:1719219514838441002, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:35.363370] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96464-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.363918] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:35.363957] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:35.368168] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96466-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.370686] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96467-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.373216] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96468-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.375260] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [960][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:35.375428] INFO [MDS] flush (mds_table_mgr.cpp:172) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BA-0-0] [lt=22] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:35.375561] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BA-0-0] [lt=127] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:35.377797] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.385539] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219515384488000, start_id=1719219515384488000, end_id=1719219515384488001) [2024-06-24 16:58:35.394945] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96471-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.397545] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96472-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:35.404685] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96474-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:35.407338] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:35.407431] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:35.407592] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:35.407660] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:35.407670] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219515406687000, start_id=1719219515406687000, end_id=1719219515406687001) [2024-06-24 16:58:35.407793] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:35.407857] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:35.407952] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96476-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:35.408097] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=312, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:35.408128] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=11, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:35.408158] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:35.408186] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=367, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:35.408204] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=27, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:35.419938] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129670, mem_used=326519808) [2024-06-24 16:58:35.420689] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96477-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.423273] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1364][T1004_LCLSender][T1004][Y0-0000000000000000-0-0] [lt=44] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47231fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:35.425129] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2024-06-24 16:58:35.427130] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219515426718000, start_id=1719219515426718000, end_id=1719219515426718001) [2024-06-24 16:58:35.427563] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=3169793, this={dio_aligned_buf:{buf_write_offset:35, buf_padding_size:4061, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:114881, truncate_used_ts:30449}, log_block_size:67108864, dir_fd:667, io_fd:668}, aligned_buf_len=8192, aligned_block_offset=3166208, buf_len=546, total_write_size_=81132, total_write_size_after_dio_=610304, ob_pwrite_used_ts=52275, count=129, each_pwrite_cost=405) [2024-06-24 16:58:35.428564] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1003) [2024-06-24 16:58:35.430726] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219515429890000, start_id=1719219515429890000, end_id=1719219515429890001) [2024-06-24 16:58:35.431148] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=6418053, this={dio_aligned_buf:{buf_write_offset:167, buf_padding_size:3929, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:132387, truncate_used_ts:33040}, log_block_size:67108864, dir_fd:682, io_fd:683}, aligned_buf_len=8192, aligned_block_offset=6414336, buf_len=546, total_write_size_=81042, total_write_size_after_dio_=610304, ob_pwrite_used_ts=46613, count=129, each_pwrite_cost=361) [2024-06-24 16:58:35.453299] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.456378] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96483-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:35.458959] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96484-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.461066] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] run rewrite rule refresh task(rule_mgr_->tenant_id_=1004) [2024-06-24 16:58:35.463257] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219515462565000, start_id=1719219515462565000, end_id=1719219515462565001) [2024-06-24 16:58:35.464326] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1211) [2024-06-24 16:58:35.464386] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=366, avg_log_submit_to_slide_time=376) [2024-06-24 16:58:35.477852] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.480355] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:35.491539] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=30] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2024-06-24 16:58:35.493516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283400302592, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:35.493562] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219515493002000, start_id=1719219515493002000, end_id=1719219515493002001) [2024-06-24 16:58:35.504254] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96497-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:35.517848] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB48-0-0] [lt=28][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103411609213, cache_obj->added_lc()=false, cache_obj->get_object_id()=9356, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:35.519608] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:35.519736] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1719219515321038000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198691, in_cluster_service=true, cluster_version={val:1719219515121461000, v:0}, min_cluster_version={val:1719219515121461000, v:0}, max_cluster_version={val:1719219515121461000, v:0}, get_cluster_version_err=0, cluster_version_delta=398268, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60469, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219313404268000, v:0}, local_cluster_delta=202115461, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:35.521396] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:35.521511] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506692887000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:35.521776] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] get number(ret=0, service_type_=0, range=1, base_id=1719219515521518000, start_id=1719219515521518000, end_id=1719219515521518001) [2024-06-24 16:58:35.522244] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=365, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:35.522273] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=11, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:35.531901] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8BCA-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219515530971000, start_id=1719219515530971000, end_id=1719219515530971001) [2024-06-24 16:58:35.532350] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=12123) [2024-06-24 16:58:35.532398] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=12123) [2024-06-24 16:58:35.532437] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=23, avg_log_gen_to_freeze_time=19, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=363, avg_log_submit_to_slide_time=373) [2024-06-24 16:58:35.537918] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964A5-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:35.538198] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964A5-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:35.538418] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964A5-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:35.538648] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964A5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:35.539018] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964A5-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:35.540170] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=22] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:35.543237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:35.548666] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219515547870000, start_id=1719219515547870000, end_id=1719219515547870001) [2024-06-24 16:58:35.549328] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get wrs ts(ls_id={id:1}, delta=119037, log_service_ts=1719219515429890, min_tx_service_ts=4611686018427387, timestamp={val:1719219515429890000, v:0}) [2024-06-24 16:58:35.549362] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:214) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1003, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=98, Other_Error_Cnt=0, Submit_Succ_Cnt=2, last_scn="{val:1719219515184884001, v:0}", last_lsn={lsn:73517490}, last_gts={val:1719219515429890000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2024-06-24 16:58:35.550657] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1719219515550654, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-06-24 16:58:35.553361] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.556275] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-06-24 16:58:35.558202] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219515557383000, start_id=1719219515557383000, end_id=1719219515557383001) [2024-06-24 16:58:35.558708] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=53460783, this={dio_aligned_buf:{buf_write_offset:336, buf_padding_size:3760, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:89810, truncate_used_ts:24193}, log_block_size:67108864, dir_fd:658, io_fd:660}, aligned_buf_len=8192, aligned_block_offset=53456896, buf_len=545, total_write_size_=39048, total_write_size_after_dio_=466944, ob_pwrite_used_ts=38913, count=104, each_pwrite_cost=374) [2024-06-24 16:58:35.560343] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219515559498000, start_id=1719219515559498000, end_id=1719219515559498001) [2024-06-24 16:58:35.560425] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7783, avg_group_log_size=598) [2024-06-24 16:58:35.560454] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8319) [2024-06-24 16:58:35.560776] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7783) [2024-06-24 16:58:35.560815] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7783) [2024-06-24 16:58:35.560850] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=348, avg_log_submit_to_slide_time=360) [2024-06-24 16:58:35.562720] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=25] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13728, offset=3447826}, end_cursor:ObLogCursor{file_id=1, log_id=13729, offset=3448099}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c4c050, len:1006, log_data_len:273, seq:13728, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:35.564580] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:463) [163725][T1002_TeRec][T1002][YB42AC141156-00061B9D8CC0D90A-0-0] [lt=18] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=207974000, MAX_GAP=900000000000, new_sync_scn={val:1719219514544839000, v:0}, new_replayable_scn={val:1719219514544839000, v:0}, new_readable_scn={val:1719219514336865000, v:0}, old_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719219513525317000, v:0}, replayable_scn:{val:1719219513525317000, v:0}, standby_scn:{val:1719219513340304000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1001}}) [2024-06-24 16:58:35.564810] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D90A-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219515564782000, start_id=1719219515564782000, end_id=1719219515564782001) [2024-06-24 16:58:35.565700] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=26] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13729, offset=3448099}, end_cursor:ObLogCursor{file_id=1, log_id=13730, offset=3448364}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c50050, len:733, log_data_len:265, seq:13729, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:35.568367] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:99191, max_lsn:73519860, max_scn:{val:1719219515547870000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:73519860}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:31576820}}, last_submit_lsn:{lsn:73519271}, last_submit_end_lsn:{lsn:73519860}, last_submit_log_id:99191, last_submit_log_pid:1, max_flushed_lsn:{lsn:73519271}, max_flushed_end_lsn:{lsn:73519860}, max_flushed_log_pid:1, committed_end_lsn:{lsn:73519860}, last_slide_log_id:99191, last_slide_scn:{val:1719219515547870000, v:0}, last_slide_lsn:{lsn:73519271}, last_slide_end_lsn:{lsn:73519860}, last_slide_log_pid:1, last_slide_log_accum_checksum:1613896886, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46f1dbc530}, [StateMgr]={this:0x7f46f1dc02b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:99192, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213354015462, palf_role_change_cb:0x7f46f1dc6cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46f1dbdc70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1003/1/meta", dir_fd:681, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46f1dc2478, flashback_version:0}, log_storage:{log_tail:{lsn:73519860}, readable_log_tail:{lsn:73519860}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719218755426586001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1003/1/log", dir_fd:682, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:60689676, block_header_serialize_buf_:0x7f46f1dc4138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213354015379, this:0x7f46f1dc09f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213354015961, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46f1dc0430}) [2024-06-24 16:58:35.568716] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=345] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219515549124, last_flushed_end_lsn:{lsn:73519860}}]) [2024-06-24 16:58:35.568739] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=19] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=99192, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219515549124, last_flushed_end_lsn:{lsn:73519860}}]) [2024-06-24 16:58:35.574694] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1003) [2024-06-24 16:58:35.574731] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=32] start lib cache evict(tenant_id=1003, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:35.574749] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=15] end lib cache evict(tenant_id=1003, cache_evict_num=0, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:35.574767] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:35.577908] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.582871] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=144, alloc_obj_list=[{obj_id:6, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:7, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:182, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:183, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:195, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:196, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195296}, {obj_id:199, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198764}, {obj_id:232, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197576}, {obj_id:237, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:238, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:242, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:246, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:248, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:250, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:251, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:252, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:253, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:254, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:255, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:256, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190960}, {obj_id:257, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:258, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:259, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:265, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:267, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193914}, {obj_id:268, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:269, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:270, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:271, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:273, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245001}, {obj_id:274, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238477}, {obj_id:278, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303661}, {obj_id:280, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250140}, {obj_id:282, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265464}, {obj_id:283, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260287}, {obj_id:285, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:286, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:287, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:288, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:289, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:290, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:291, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:292, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:293, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:294, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:296, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:297, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:298, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:299, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:300, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:302, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:306, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:307, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:308, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:310, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:311, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:313, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:314, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:315, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192384}, {obj_id:316, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:317, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:318, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179373}, {obj_id:319, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:320, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:321, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:322, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214835}, {obj_id:323, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257749}, {obj_id:324, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257679}, {obj_id:325, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:301211}, {obj_id:326, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:322954}, {obj_id:327, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255184}, {obj_id:328, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253823}, {obj_id:329, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:326827}, {obj_id:330, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262876}, {obj_id:331, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283304}, {obj_id:332, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296168}, {obj_id:333, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:261538}, {obj_id:334, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:285869}, {obj_id:335, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300008}, {obj_id:336, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183813}, {obj_id:337, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215145}, {obj_id:338, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252630}, {obj_id:339, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273088}, {obj_id:340, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280836}, {obj_id:341, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275631}, {obj_id:342, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:284691}, {obj_id:343, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250120}, {obj_id:344, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246226}, {obj_id:345, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247565}, {obj_id:346, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242359}, {obj_id:347, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:348, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:349, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:350, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:351, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265421}, {obj_id:352, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269241}, {obj_id:353, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270506}, {obj_id:354, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276928}, {obj_id:355, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267956}, {obj_id:356, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273080}, {obj_id:357, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280749}, {obj_id:358, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292309}, {obj_id:359, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278185}, {obj_id:360, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288460}, {obj_id:361, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288428}, {obj_id:362, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303857}, {obj_id:363, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:364, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:365, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:366, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:367, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:368, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:369, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419863}, {obj_id:371, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312858}, {obj_id:372, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417607}, {obj_id:373, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:374, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:375, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:376, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:377, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:378, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:379, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:380, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:384, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:385, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200158}, {obj_id:386, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332258}, {obj_id:387, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:388, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:434, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187881}, {obj_id:435, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269004}, {obj_id:436, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:437, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:500, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297770}, {obj_id:686, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175750}, {obj_id:687, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189803}, {obj_id:688, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465848}, {obj_id:689, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461380}, {obj_id:690, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:352652}, {obj_id:691, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:850328}, {obj_id:692, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195368}, {obj_id:693, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276678}, {obj_id:694, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:695, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272832}, {obj_id:696, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242168}]) [2024-06-24 16:58:35.583492] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=618] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:35.585827] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219515584870000, start_id=1719219515584870000, end_id=1719219515584870001) [2024-06-24 16:58:35.599782] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:227) [162289][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=26] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=0) [2024-06-24 16:58:35.607787] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219515607085000, start_id=1719219515607085000, end_id=1719219515607085001) [2024-06-24 16:58:35.608676] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1719219505606643, end_time=1719219515608673, dag_status={}) [2024-06-24 16:58:35.608712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608736] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608749] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608779] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608796] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608813] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608827] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:35.608856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608876] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608893] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608909] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608944] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608968] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.608987] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609003] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609020] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609036] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609052] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609068] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609085] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609118] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609134] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609150] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609165] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609180] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609196] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609230] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609245] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609260] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609276] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609337] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609355] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609371] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609386] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609402] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609432] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609463] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609480] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609495] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609511] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609526] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609572] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609603] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609620] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609647] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609662] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609677] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609693] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609739] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609757] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609772] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:35.609804] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:35.609817] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:35.609831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:35.609841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:35.609852] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:35.609863] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:35.609874] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:35.609884] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:35.609898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:35.609908] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:35.609920] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:35.620099] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:35.620792] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:35.646596] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1003, server_version={version:{val:1719219515429890000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=216699, in_cluster_service=true, cluster_version={val:1719219515347478000, v:0}, min_cluster_version={val:1719219515347478000, v:0}, max_cluster_version={val:1719219515347478000, v:0}, get_cluster_version_err=0, cluster_version_delta=299111, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59868, succ_cluster_heartbeat_count=9, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219471621660000, v:0}, local_cluster_delta=44024929, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:35.650695] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964D0-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.653242] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964D1-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.653435] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.658568] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C45-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.661182] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964D3-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.663738] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964D4-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.664471] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=316, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:35.664491] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1635) [2024-06-24 16:58:35.664507] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:35.664492] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1211) [2024-06-24 16:58:35.664546] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:35.664570] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=381, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:35.664586] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:35.677964] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.685040] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964DD-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.687584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964DE-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:35.691530] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB964E0-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:35.692666] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=24] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2024-06-24 16:58:35.692795] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=30] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=375809635, ret=0) [2024-06-24 16:58:35.692896] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=17] set tenant work area memory(tenant_id=1003, wa_pctg=5, limit=157286400, ret=0) [2024-06-24 16:58:35.692998] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=13] set tenant work area memory(tenant_id=1004, wa_pctg=5, limit=773094110, ret=0) [2024-06-24 16:58:35.694021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283402399744, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:35.694463] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:35.694569] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:35.698558] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:35.698648] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:35.698819] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:35.698892] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:35.698995] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C78-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:35.699763] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=28] gc stale ls task succ [2024-06-24 16:58:35.705890] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1719219515426718000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=279165, in_cluster_service=true, cluster_version={val:1719219515406687000, v:0}, min_cluster_version={val:1719219515406687000, v:0}, max_cluster_version={val:1719219515406687000, v:0}, get_cluster_version_err=0, cluster_version_delta=299196, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60157, succ_cluster_heartbeat_count=10, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219444964826000, v:0}, local_cluster_delta=70741057, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:35.708544] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=57] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:35.711463] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C79-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.720771] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219515720085000, start_id=1719219515720085000, end_id=1719219515720085001) [2024-06-24 16:58:35.721457] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=14] ====== tenant freeze timer task ====== [2024-06-24 16:58:35.722107] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:35.722149] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=29] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:35.722210] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=103043762, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:35.723216] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=34131, mem_used=139342848) [2024-06-24 16:58:35.729958] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:35.743333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:35.745006] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=13] === Run print tenant memory usage task === [2024-06-24 16:58:35.745098] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=16] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 288,169,984 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 2,043,682,816 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 42,557,440 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 25,780,224 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,719,219,515,744,314 active_memstore_used= 136,314,880 total_memstore_used= 136,314,880 total_memstore_hold= 136,314,880 memstore_freeze_trigger_limit= 1,825,361,100 memstore_limit= 9,126,805,500 mem_tenant_limit= 18,253,611,008 mem_tenant_hold= 1,574,858,752 max_mem_memstore_can_get_now= 14,900,367,360 memstore_alloc_pos= 192,937,984 memstore_frozen_pos= 56,623,104 memstore_reclaimed_pos= 56,623,104 [TENANT_MEMORY] tenant_id= 1,001 now= 1,719,219,515,744,314 active_memstore_used= 46,137,344 total_memstore_used= 46,137,344 total_memstore_hold= 46,137,344 memstore_freeze_trigger_limit= 66,484,200 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 526,340,096 max_mem_memstore_can_get_now= 332,421,094 memstore_alloc_pos= 96,468,992 memstore_frozen_pos= 50,331,648 memstore_reclaimed_pos= 50,331,648 [TENANT_MEMORY] tenant_id= 1,002 now= 1,719,219,515,744,314 active_memstore_used= 421,527,552 total_memstore_used= 421,527,552 total_memstore_hold= 421,527,552 memstore_freeze_trigger_limit= 601,295,400 memstore_limit= 3,006,477,080 mem_tenant_limit= 7,516,192,768 mem_tenant_hold= 1,638,031,360 max_mem_memstore_can_get_now= 4,202,536,960 memstore_alloc_pos= 723,517,440 memstore_frozen_pos= 301,989,888 memstore_reclaimed_pos= 301,989,888 [TENANT_MEMORY] tenant_id= 1,003 now= 1,719,219,515,744,314 active_memstore_used= 46,137,344 total_memstore_used= 46,137,344 total_memstore_hold= 46,137,344 memstore_freeze_trigger_limit= 117,442,300 memstore_limit= 687,194,760 mem_tenant_limit= 1,717,986,918 mem_tenant_hold= 669,392,896 max_mem_memstore_can_get_now= 587,211,544 memstore_alloc_pos= 104,857,600 memstore_frozen_pos= 58,720,256 memstore_reclaimed_pos= 58,720,256 [TENANT_MEMORY] tenant_id= 1,004 now= 1,719,219,515,744,314 active_memstore_used= 199,229,440 total_memstore_used= 199,229,440 total_memstore_hold= 199,229,440 memstore_freeze_trigger_limit= 1,546,188,220 memstore_limit= 7,730,941,100 mem_tenant_limit= 15,461,882,266 mem_tenant_hold= 1,612,541,952 max_mem_memstore_can_get_now= 11,945,126,298 memstore_alloc_pos= 255,852,544 memstore_frozen_pos= 56,623,104 memstore_reclaimed_pos= 56,623,104 [2024-06-24 16:58:35.745310] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=42] [CHUNK_MGR] limit=296,352,743,424 hold= 8,501,202,944 total_hold= 8,826,912,768 used= 8,133,185,536 freelists_hold= 368,017,408 total_maps= 3,049 total_unmaps= 98 large_maps= 195 large_unmaps= 0 huge_maps= 32 huge_unmaps= 8 memalign=0 resident_size= 8,141,332,480 virtual_memory_used= 9,925,324,800 [CHUNK_MGR] 2 MB_CACHE: hold= 249,561,088 free= 119 pushes= 16,139,569 pops= 16,139,450 maps= 2,822 unmaps= 90 [CHUNK_MGR] 4 MB_CACHE: hold= 38,621,184 free= 17 pushes= 11,703 pops= 11,686 maps= 126 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 0 free= 0 pushes= 45 pops= 45 maps= 18 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 10,359 pops= 10,357 maps= 10 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 16,818,176 free= 2 pushes= 12 pops= 10 maps= 29 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 50,393,088 free= 3 pushes= 8 pops= 5 maps= 9 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [2024-06-24 16:58:35.745565] INFO print (ob_malloc_time_monitor.cpp:39) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=17] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 0, 10): delta_total_cost_time= 534297, delta_count= 709059, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10, 100): delta_total_cost_time= 17195, delta_count= 795, avg_cost_time= 21 [MALLOC_TIME_MONITOR] [ 100, 1000): delta_total_cost_time= 3431, delta_count= 30, avg_cost_time= 114 [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 4482, delta_count= 1, avg_cost_time= 4482 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2024-06-24 16:58:35.748598] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=59] get number(ret=0, service_type_=0, range=1, base_id=1719219515748530000, start_id=1719219515748530000, end_id=1719219515748530001) [2024-06-24 16:58:35.748691] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=49] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:35.748726] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:35.749161] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=317, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:35.749199] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=14, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:35.749228] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:35.749267] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=385, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:35.749286] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=27, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:35.752276] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C87-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:35.753491] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.755354] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C88-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.760565] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219515760123000, start_id=1719219515760123000, end_id=1719219515760123001) [2024-06-24 16:58:35.764583] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1635) [2024-06-24 16:58:35.764614] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=362, avg_log_submit_to_slide_time=372) [2024-06-24 16:58:35.764911] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494465, support_ssl=false) [2024-06-24 16:58:35.764998] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] sm conn init succ(conn.sessid_=3221494465, sess.client_addr_="172.20.17.86:49506") [2024-06-24 16:58:35.765021] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f46bf5f6d70, session_id:3221494465, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:35.765102] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6d70, session_id:3221494465, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:35.765134] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494465, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:35.765153] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f46bf5f6d70, session_id:3221494465, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:35.765175] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] mark session id unused(conn.sessid_=3221494465) [2024-06-24 16:58:35.765188] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162490][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494465, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:35.778018] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.785845] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219515785406000, start_id=1719219515785406000, end_id=1719219515785406001) [2024-06-24 16:58:35.786373] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=10] [APPLY STAT CB APPEND COST TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=30, this=0x7f46f1dd4280, extra_info="") [2024-06-24 16:58:35.786412] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=38] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=398, this=0x7f46f1dd44b0, extra_info="") [2024-06-24 16:58:35.786433] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=20] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=0, this=0x7f46f1dd46e0, extra_info="") [2024-06-24 16:58:35.786448] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=-499, this=0x7f46f1dd4910, extra_info="") [2024-06-24 16:58:35.786462] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=-70, this=0x7f46f1dd4b40, extra_info="") [2024-06-24 16:58:35.803433] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073ED7-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:35.807816] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219515807571000, start_id=1719219515807571000, end_id=1719219515807571001) [2024-06-24 16:58:35.809315] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8C9C-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:35.814566] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=45] LogLoopThread round_cost_time(us)(round_cost_time=13) [2024-06-24 16:58:35.825020] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=7] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=19, mem_used=49913856) [2024-06-24 16:58:35.825044] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=18] release old cannot free more memory [2024-06-24 16:58:35.825054] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=9] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=37, size_used=0, mem_used=49913856) [2024-06-24 16:58:35.840286] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219515839261000, start_id=1719219515839261000, end_id=1719219515839261001) [2024-06-24 16:58:35.840316] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] ts response task statistics(alloc_count=248198, free_count=124098) [2024-06-24 16:58:35.840345] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219515840279], gts:1719219515839261000, latest_srr:[mts=1719219515840279]}) [2024-06-24 16:58:35.840384] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=390, get_gts_with_stc_cnt=61, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=61, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:35.840406] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219515840369], gts:1719219515840319000, latest_srr:[mts=1719219515840369]}) [2024-06-24 16:58:35.840438] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=8444, get_gts_with_stc_cnt=48, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=46, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:35.840458] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219515840422], gts:1719219515840319000, latest_srr:[mts=1719219515840422]}) [2024-06-24 16:58:35.840487] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219515840474], gts:1719219515840319000, latest_srr:[mts=1719219515840474]}) [2024-06-24 16:58:35.853551] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.856357] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=19] current monitor number(seq_=-1) [2024-06-24 16:58:35.858600] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1719219515493002000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=365594, in_cluster_service=true, cluster_version={val:1719219515493002000, v:0}, min_cluster_version={val:1719219515493002000, v:0}, max_cluster_version={val:1719219515493002000, v:0}, get_cluster_version_err=0, cluster_version_delta=365594, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60084, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219385327519000, v:0}, local_cluster_delta=130531077, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:35.873184] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873663] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873670] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873770] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.873951] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874093] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874155] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874294] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874301] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874313] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874312] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874317] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874315] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874331] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874336] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874351] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874362] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874556] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874638] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874640] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.874928] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:35.878073] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.878057] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [966][T1001_ArcFetche][T1001][YB42AC141156-00061B9D8DA0C0E5-0-0] [lt=35] ObArchiveFetcher is running(thread_index=0) [2024-06-24 16:58:35.883857] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1004, server_version={version:{val:1719219515462565002, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=421286, in_cluster_service=true, cluster_version={val:1719219515462565001, v:0}, min_cluster_version={val:1719219515462565001, v:0}, max_cluster_version={val:1719219515462565001, v:0}, get_cluster_version_err=0, cluster_version_delta=421286, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59910, succ_cluster_heartbeat_count=6, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219412155330001, v:0}, local_cluster_delta=103728521, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:35.886569] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2164) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:517647832}], scn_array=[cnt:1, {val:1719219515840319000, v:0}], curr_size=122, accum_size=1486, time_cost=14211) [2024-06-24 16:58:35.886569] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2164) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:32428939}], scn_array=[cnt:1, {val:1719219515840319000, v:0}], curr_size=122, accum_size=1766, time_cost=14227) [2024-06-24 16:58:35.886598] INFO [STORAGE.REDO] write_logs (ob_storage_log_writer.cpp:512) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Slow write(duration=15209, write_len=4096) [2024-06-24 16:58:35.886614] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1766) [2024-06-24 16:58:35.886642] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16481, offset=3754571}, end_cursor:ObLogCursor{file_id=1, log_id=16482, offset=3754844}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c54050, len:1461, log_data_len:273, seq:16481, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:35.888634] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FB-0-0] [lt=35][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:35.888660] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FB-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1665, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:35.888984] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FB-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334343862533569336e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.950271661537344414e+01) [2024-06-24 16:58:35.891310] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FB-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219515890940000, start_id=1719219515890940000, end_id=1719219515890940001) [2024-06-24 16:58:35.891421] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FB-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8422, avg_group_log_size=601) [2024-06-24 16:58:35.891450] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FB-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8424) [2024-06-24 16:58:35.891774] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8422) [2024-06-24 16:58:35.891822] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8422) [2024-06-24 16:58:35.891855] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=367, avg_log_submit_to_slide_time=379) [2024-06-24 16:58:35.891881] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219515890940000, start_id=1719219515890940001, end_id=1719219515890940002) [2024-06-24 16:58:35.892598] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16482, offset=3754844}, end_cursor:ObLogCursor{file_id=1, log_id=16483, offset=3755109}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c58050, len:1188, log_data_len:265, seq:16482, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:35.894524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283398205440, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:35.909153] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1586][T1003_LCLSender][T1003][Y0-0000000000000000-0-0] [lt=32] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47041fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:35.911311] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=27] gc stale ls task succ [2024-06-24 16:58:35.921001] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1719219515920999, bytes: 170691429, bw: 0.018589 MB/s, add_ts: 1007615, add_bytes: 19640 [2024-06-24 16:58:35.921952] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219515921436000, start_id=1719219515921436000, end_id=1719219515921436001) [2024-06-24 16:58:35.927594] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [162941][T1_RFLWorker][T1][YB42AC141156-00061B9D8700C0E5-0-0] [lt=26] ObRemoteFetchWorker is running(thread_index=0) [2024-06-24 16:58:35.943423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:35.948733] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219515947749000, start_id=1719219515947749000, end_id=1719219515947749001) [2024-06-24 16:58:35.953611] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.958672] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=90] no need to update min/max version(new_version={val:1719219515493002000, v:0}, min_version={val:1719219515493002000, v:0}, max_version={val:1719219515493002000, v:0}) [2024-06-24 16:58:35.964312] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:35.964351] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1635, avg_group_log_size=163) [2024-06-24 16:58:35.964379] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1635) [2024-06-24 16:58:35.964404] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:35.964433] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:35.964968] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=328, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:35.967768] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CD8-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.974947] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CD9-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:35.978128] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:35.980208] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CDA-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:35.983078] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CDB-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:35.985970] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CDC-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:35.986054] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1719219515985632000, start_id=1719219515985632000, end_id=1719219515985632001) [2024-06-24 16:58:35.986833] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=130] get_max_applied_scn(scn={val:1719219515840319000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:57972654}, palf_committed_end_scn_:{val:1719219515840319001, v:0}, last_check_scn_:{val:1719219515840319001, v:0}, max_applied_cb_scn_:{val:1719219515840319000, v:0}}) [2024-06-24 16:58:35.986875] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=39] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213369678630001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:36.002653] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:36.003483] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:36.003525] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get_max_applied_scn(scn={val:1719219515921436000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:53458524}, palf_committed_end_scn_:{val:1719219515921436000, v:0}, last_check_scn_:{val:1719219515921436000, v:0}, max_applied_cb_scn_:{val:1719219515921436000, v:0}}) [2024-06-24 16:58:36.003561] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:36.005764] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=115] succ to get rec scn(*this={this:0x7f47b3e04030, ls_id:{id:1}, tenant_id:1, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216858758544000, v:0}, last_push_gc_task_ts_:1719216859472314, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1025}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.005799] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47b6924080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216859475873, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47b6924080, snapshot_version:{val:1719216859475873, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.005843] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:36.006049] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:36.006166] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=112] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f47b684c1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f47b685a0d0, memtable_head:3, memtable_tail:4, t3m:0x7f47ded72030, tables:[null, null, null, 0x7f47b6914080, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215058499657, tx_data_table:0x7f47b685bb90, ls_tablet_svr:0x7f47b684c190}, min_rec_scn={val:1719216859633263000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:36.006217] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:36.006238] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219512119150001, v:0}) [2024-06-24 16:58:36.006252] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.006266] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.006286] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216859633263000, v:0}, checkpoint_scn_in_ls_meta={val:1719216859633263000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:36.006314] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:36.006338] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:36.006354] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:36.008009] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516007801000, start_id=1719219516007801000, end_id=1719219516007801001) [2024-06-24 16:58:36.008595] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:36.010656] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE4-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.013495] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE5-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.017921] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE7-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.020691] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:36.020790] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:36.020975] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:36.021030] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:36.021183] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:36.021249] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:36.021341] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CE9-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:36.026157] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [928][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=23][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:36.026260] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [928][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=33][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:36.032521] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 388.00) [2024-06-24 16:58:36.032551] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:36.032671] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 7806.00) [2024-06-24 16:58:36.032695] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:36.032729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032748] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032795] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032808] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032821] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032835] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032848] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032862] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032875] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032889] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032903] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032932] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.032946] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:36.033350] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CEA-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4565, pos=3045, bitmap=NULL) [2024-06-24 16:58:36.036789] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [383][T1002_ArcSender][T1002][YB42AC141156-00061B9D8D10C0E5-0-0] [lt=50][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:36.037990] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] tx gc loop thread is running(MTL_ID()=1) [2024-06-24 16:58:36.038018] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] try gc retain ctx [2024-06-24 16:58:36.040281] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:36.053682] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.054201] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:36.060685] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219516060528000, start_id=1719219516060528000, end_id=1719219516060528001) [2024-06-24 16:58:36.061369] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213342229334001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:36.072436] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:36.072469] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:36.072490] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:36.072507] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:36.072849] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1281, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:36.072851] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1771, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:36.072878] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:36.072879] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:36.072911] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=7, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:36.072940] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1366, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:36.072963] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=28, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:36.072990] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:36.073005] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1853, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:36.073016] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=9] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:36.073718] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CF9-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.076760] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8CFA-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:36.078182] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.095040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283396108288, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:36.095062] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=562, mem_used=2079744) [2024-06-24 16:58:36.096552] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096584] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096666] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096673] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096965] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096970] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096971] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096970] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.096971] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097044] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097117] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097294] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097553] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097666] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097683] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097684] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097688] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.097714] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098068] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098077] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098083] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098144] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098203] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098221] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098241] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098385] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098387] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098417] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098447] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098442] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098677] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098682] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098682] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.098722] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.099278] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.099524] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.109758] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=37] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:36.111352] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:36.111389] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=25] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:36.111422] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=73524678, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:36.112991] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1D-0-0] [lt=33] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:36.113020] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1D-0-0] [lt=21] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=32) [2024-06-24 16:58:36.121108] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219516120631000, start_id=1719219516120631000, end_id=1719219516120631001) [2024-06-24 16:58:36.121650] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8B70FC04-0-0] [lt=19] [APPLY STAT CB APPEND COST TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=34, this=0x7f47b68f8280, extra_info="") [2024-06-24 16:58:36.121677] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8B70FC04-0-0] [lt=26] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=434, this=0x7f47b68f84b0, extra_info="") [2024-06-24 16:58:36.121693] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8B70FC04-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=0, this=0x7f47b68f86e0, extra_info="") [2024-06-24 16:58:36.121708] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8B70FC04-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=-476, this=0x7f47b68f8910, extra_info="") [2024-06-24 16:58:36.121721] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8B70FC04-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=-7, this=0x7f47b68f8b40, extra_info="") [2024-06-24 16:58:36.132227] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D0B-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.133581] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=20] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:36.140009] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=11] Garbage Collector is running(seq_=620, gc_interval=10000000) [2024-06-24 16:58:36.140083] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=35] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:36.140120] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] gc_check_member_list_ cost time(ret=0, time_us=72) [2024-06-24 16:58:36.140140] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:36.142105] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:36.142144] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=32] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:36.142166] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=24) [2024-06-24 16:58:36.142180] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:36.142194] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2024-06-24 16:58:36.142228] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2024-06-24 16:58:36.143520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:36.144565] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D8-0-0] [lt=16] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:36.144605] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D8-0-0] [lt=36] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:36.146404] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F3-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:36.146438] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F3-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:36.148855] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219516148096000, start_id=1719219516148096000, end_id=1719219516148096001) [2024-06-24 16:58:36.153741] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.164474] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1333) [2024-06-24 16:58:36.164834] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:36.164871] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:36.164904] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=400, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:36.164921] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:36.172498] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1644, avg_group_log_size=164) [2024-06-24 16:58:36.172522] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1644) [2024-06-24 16:58:36.173304] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1644) [2024-06-24 16:58:36.173335] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=1876, avg_log_submit_to_slide_time=1884) [2024-06-24 16:58:36.175023] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=20] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:36.178237] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.179352] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D426-0-0] [lt=19] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.179770] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D428-0-0] [lt=30] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.183580] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:174) [163820][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=19] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2024-06-24 16:58:36.183617] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [163820][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=33] finish to resize log external storage handler(current_ts=1719219516183613, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:36.186092] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=114] get number(ret=0, service_type_=0, range=1, base_id=1719219516185964000, start_id=1719219516185964000, end_id=1719219516185964001) [2024-06-24 16:58:36.201359] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:36.208129] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219516208090000, start_id=1719219516208090000, end_id=1719219516208090001) [2024-06-24 16:58:36.209305] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=11] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:36.211121] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=34] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:36.211223] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506784804000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:36.223972] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D476-0-0] [lt=13] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.238085] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=108] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:36.238104] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:36.238458] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3826) [2024-06-24 16:58:36.238508] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3826) [2024-06-24 16:58:36.238557] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:36.238577] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=474, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:36.238593] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=31, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:36.251082] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1719219506249076, end_time=1719219516251078, dag_status={}) [2024-06-24 16:58:36.251123] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251168] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251195] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251218] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251236] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251249] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251264] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251277] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:36.251291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251311] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251327] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251343] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251394] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251410] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251427] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251442] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251490] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251524] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251569] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251585] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251600] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251659] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=43] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251677] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251693] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251709] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251724] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251771] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251838] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251854] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251870] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251886] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251901] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251917] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251933] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251951] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251967] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251983] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.251998] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252014] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252061] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252094] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252110] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252125] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252140] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252156] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252172] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252187] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252206] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252237] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:36.252253] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:36.252267] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:36.252280] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:36.252291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:36.252302] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:36.252313] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:36.252324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:36.252334] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:36.252347] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:36.252357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:36.252370] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:36.253496] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A4-0-0] [lt=57][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:36.253800] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.260833] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=103] get number(ret=0, service_type_=0, range=1, base_id=1719219516259820000, start_id=1719219516259820000, end_id=1719219516259820001) [2024-06-24 16:58:36.272580] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=5334, avg_group_log_size=355) [2024-06-24 16:58:36.272600] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=5334) [2024-06-24 16:58:36.278151] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=26] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:36.278186] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=34] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:36.278180] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E1-0-0] [lt=9] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:36.278209] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E1-0-0] [lt=26] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:36.278291] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.295552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283396108288, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:36.299501] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D48-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:36.302438] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D49-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.304733] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=5] ====== checkpoint timer task ====== [2024-06-24 16:58:36.305815] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] succ to get rec scn(*this={this:0x7f474be04030, ls_id:{id:1}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215719054755000, v:0}, last_push_gc_task_ts_:1719216936767864, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.305843] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739404080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216936773978, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739404080, snapshot_version:{val:1719216936773978, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.305888] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:36.305973] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219513525317000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:36.306042] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=66] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f4753c761b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f4753c840d0, memtable_head:2, memtable_tail:3, t3m:0x7f4782d1e030, tables:[null, null, 0x7f4753dced90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215135780086, tx_data_table:0x7f4753c85b90, ls_tablet_svr:0x7f4753c76190}, min_rec_scn={val:1719216939041208000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:36.306078] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=30] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:36.306091] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=0, rec_log_ts={val:1719219509829313001, v:0}) [2024-06-24 16:58:36.306098] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=7] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.306110] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=5] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216939041208000, v:0}, checkpoint_scn_in_ls_meta={val:1719216939041208000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:36.306129] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:36.306143] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:36.307298] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=6] succ to get rec scn(*this={this:0x7f474beb6030, ls_id:{id:1001}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213748817809002, v:0}, last_push_gc_task_ts_:1719215150704743, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:580}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.307315] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739405350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215150709832, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739405350, snapshot_version:{val:1719215150709832, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:36.307336] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:36.307376] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219513525317000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:36.307472] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=54] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f4736709790}, min_rec_scn={val:1719215150797158000, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:36.307484] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=10] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213342229334001, v:0}) [2024-06-24 16:58:36.307497] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215150797158000, v:0}, checkpoint_scn_in_ls_meta={val:1719215150797158000, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:36.307510] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:201314304}, new_base_lsn={lsn:201314304}, lsn={lsn:201314304}) [2024-06-24 16:58:36.307523] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:201314304}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:36.307529] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=5] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:36.307698] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D4B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:36.310803] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A3A68-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:36.313785] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D4D-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:36.318039] INFO [ARCHIVE] load_archive_round_attr (ob_archive_persist_mgr.cpp:323) [1389][T1004_ArcSrv][T1004][YB42AC141156-00061B9D9390C0E5-0-0] [lt=33] no archive dest exist, just skip(ret=-4018, tenant_id_=1004) [2024-06-24 16:58:36.321309] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219516321101000, start_id=1719219516321101000, end_id=1719219516321101001) [2024-06-24 16:58:36.321368] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3826, avg_group_log_size=425) [2024-06-24 16:58:36.321388] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3826) [2024-06-24 16:58:36.325493] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [1371][T1004_ObXAHbWor][T1004][Y0-0000000000000000-0-0] [lt=78] XA scheduler heartbeat task statistics(avg_time=5) [2024-06-24 16:58:36.325611] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111723, mem_used=262047744) [2024-06-24 16:58:36.336871] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [967][T1001_ArcSender][T1001][YB42AC141156-00061B9D8DB0C0E5-0-0] [lt=49][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:36.338140] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D56-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.341266] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219516341124000, start_id=1719219516341124000, end_id=1719219516341124001) [2024-06-24 16:58:36.341304] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:36.341659] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC129C1-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.342403] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:36.343579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:36.346145] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D58-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.348862] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:36.348966] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:36.349042] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516348524000, start_id=1719219516348524000, end_id=1719219516348524001) [2024-06-24 16:58:36.349152] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:36.349212] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:36.349406] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:36.349481] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:36.349577] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:36.353860] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.361519] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D5B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:36.364614] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:36.364722] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=98] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:36.378347] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.386224] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219516385507000, start_id=1719219516385507000, end_id=1719219516385507001) [2024-06-24 16:58:36.386841] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1004, new_min_version={val:1719219515840319003, v:0}, new_max_version={val:1719219515840319003, v:0}, last_min_version={val:1719219515840319001, v:0}, last_max_version={val:1719219515840319001, v:0}, total_time_us=2660, delta_us=546520) [2024-06-24 16:58:36.386877] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1004, current_version={val:1719219515840319003, v:0}, min_version={val:1719219515840319003, v:0}, max_version={val:1719219515840319003, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:36.399085] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D69-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.401154] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D43C-0-0] [lt=27] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.401864] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D6A-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:36.408436] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219516407729000, start_id=1719219516407729000, end_id=1719219516407729001) [2024-06-24 16:58:36.408524] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:36.408564] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:36.408955] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=361, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:36.408980] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:36.409022] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:36.409054] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=423, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:36.409070] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=26, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:36.413325] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=21] dump dtl interm result cost(us)(dump_cost=3700, ret=0, interm count=0, dump count=626) [2024-06-24 16:58:36.416334] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=30] clear dtl interm result cost(us)(clear_cost=2977, ret=0, gc_.expire_keys_.count()=0, dump count=626, interm count=0, clean count=0) [2024-06-24 16:58:36.420063] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129683, mem_used=326519808) [2024-06-24 16:58:36.425221] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=11] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:36.425256] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=20] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1233) [2024-06-24 16:58:36.451953] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8D7B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.452890] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:36.453920] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.454550] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:36.454654] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=27] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506733030000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:36.459539] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=17] ====== tenant freeze timer task ====== [2024-06-24 16:58:36.460933] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219516460540000, start_id=1719219516460540000, end_id=1719219516460540001) [2024-06-24 16:58:36.465093] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:36.465160] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=416, avg_log_submit_to_slide_time=427) [2024-06-24 16:58:36.478411] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.480493] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:36.480889] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [162935][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=24][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:36.480991] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [162935][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=32][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:36.488448] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [162824][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=46] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:36.493641] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=52] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:36.496052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283396108288, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:36.510930] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:36.517411] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E92C-0-0] [lt=20] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1719219516517391}) [2024-06-24 16:58:36.517434] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D065-0-0] [lt=33] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:36.517765] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D065-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219516517737, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:36.517804] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D065-0-0] [lt=37] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1719219516517391}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219516517737, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:36.519657] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E92C-0-0] [lt=31] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:36.519824] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E92C-0-0] [lt=30][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:36.522288] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219516521685000, start_id=1719219516521685000, end_id=1719219516521685001) [2024-06-24 16:58:36.522765] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=378, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:36.522796] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:36.522824] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=417, avg_log_submit_to_slide_time=431) [2024-06-24 16:58:36.523206] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2024-06-24 16:58:36.523226] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] start lib cache evict(tenant_id=1002, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:36.523242] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:36.523255] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=11] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:36.524287] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC07-0-0] [lt=26][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103412615654, cache_obj->added_lc()=false, cache_obj->get_object_id()=9357, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:36.527803] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=21] ls blacklist refresh finish(cost_time=12059) [2024-06-24 16:58:36.529563] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=10] Dumping All Cache Objs(alloc_obj_list.count()=753, alloc_obj_list=[{obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:206, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:208, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:213, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:215, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:218, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:219, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:221, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:222, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:223, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:224, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:225, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:226, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:227, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:230, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:258, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:259, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207636}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157087}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:262, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417132}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:293, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:297, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178532}, {obj_id:299, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174372}, {obj_id:311, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:312, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:313, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:314, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:315, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:316, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:317, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:318, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:319, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:320, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:370, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:371, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:372, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:373, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:374, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:375, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:376, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:377, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:378, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:394, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217236}, {obj_id:404, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:405, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:431, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200789}, {obj_id:787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:1554, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174647}, {obj_id:1765, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196131}, {obj_id:1767, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180746}, {obj_id:1768, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180053}, {obj_id:1769, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156392}, {obj_id:1770, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185682}, {obj_id:1771, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178754}, {obj_id:1772, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217927}, {obj_id:1773, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182452}, {obj_id:1774, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157145}, {obj_id:1775, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193250}, {obj_id:1776, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156261}, {obj_id:1777, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202011}, {obj_id:1778, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176126}, {obj_id:1779, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:1780, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179533}, {obj_id:1782, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194286}, {obj_id:1783, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191084}, {obj_id:1784, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185716}, {obj_id:1785, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197901}, {obj_id:1786, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203431}, {obj_id:1787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177702}, {obj_id:1788, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197376}, {obj_id:1789, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194100}, {obj_id:1790, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229422}, {obj_id:1791, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342799}, {obj_id:1792, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177856}, {obj_id:1793, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:1794, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:1801, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197017}, {obj_id:1802, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197375}, {obj_id:1803, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192944}, {obj_id:1804, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210981}, {obj_id:1807, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1808, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191543}, {obj_id:1809, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190396}, {obj_id:1810, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179961}, {obj_id:1811, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187508}, {obj_id:1812, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190770}, {obj_id:1814, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174667}, {obj_id:1817, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186991}, {obj_id:1820, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181584}, {obj_id:1822, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201206}, {obj_id:1823, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187930}, {obj_id:1824, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182810}, {obj_id:1826, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205149}, {obj_id:1828, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181586}, {obj_id:1830, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184827}, {obj_id:1832, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173928}, {obj_id:1833, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241466}, {obj_id:1834, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173654}, {obj_id:1835, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174122}, {obj_id:1841, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183277}, {obj_id:1842, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202767}, {obj_id:1843, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184717}, {obj_id:1844, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179338}, {obj_id:1845, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192322}, {obj_id:1846, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186117}, {obj_id:1847, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:243066}, {obj_id:1850, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203203}, {obj_id:1851, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206987}, {obj_id:1854, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202239}, {obj_id:1857, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179623}, {obj_id:1858, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199630}, {obj_id:1859, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181089}, {obj_id:1860, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191144}, {obj_id:1861, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208300}, {obj_id:1862, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207006}, {obj_id:1864, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174459}, {obj_id:1865, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197772}, {obj_id:1866, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195985}, {obj_id:1867, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187545}, {obj_id:1868, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200975}, {obj_id:1869, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190129}, {obj_id:1870, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187648}, {obj_id:1871, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180383}, {obj_id:1872, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176694}, {obj_id:1873, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199714}, {obj_id:1874, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197401}, {obj_id:1875, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211269}, {obj_id:1878, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197823}, {obj_id:1879, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180556}, {obj_id:1880, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186838}, {obj_id:1881, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173640}, {obj_id:1882, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189084}, {obj_id:1883, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182778}, {obj_id:1884, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198543}, {obj_id:1885, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184808}, {obj_id:1886, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192715}, {obj_id:1887, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178511}, {obj_id:1889, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:1890, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190883}, {obj_id:1892, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204317}, {obj_id:1895, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200704}, {obj_id:1897, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180059}, {obj_id:1898, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189670}, {obj_id:1899, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297520}, {obj_id:1900, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180210}, {obj_id:1901, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173929}, {obj_id:1902, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207174}, {obj_id:1904, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180315}, {obj_id:1905, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175944}, {obj_id:1906, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191394}, {obj_id:1907, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205016}, {obj_id:1908, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205015}, {obj_id:1909, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205042}, {obj_id:1910, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183144}, {obj_id:1912, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156278}, {obj_id:1914, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201207}, {obj_id:1915, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205705}, {obj_id:1916, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179043}, {obj_id:1918, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210554}, {obj_id:1919, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211414}, {obj_id:1920, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203461}, {obj_id:1922, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179984}, {obj_id:1924, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194777}, {obj_id:1926, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212517}, {obj_id:1927, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185341}, {obj_id:1928, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211233}, {obj_id:1929, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180552}, {obj_id:1930, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199580}, {obj_id:1932, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200277}, {obj_id:1933, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202039}, {obj_id:1935, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202217}, {obj_id:1938, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:1939, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185428}, {obj_id:1940, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342648}, {obj_id:1941, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184408}, {obj_id:1942, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188029}, {obj_id:1943, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220581}, {obj_id:1944, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186138}, {obj_id:1945, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188109}, {obj_id:1946, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184071}, {obj_id:1947, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297497}, {obj_id:1948, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259587}, {obj_id:1949, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234741}, {obj_id:1950, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230127}, {obj_id:1951, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:1952, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199425}, {obj_id:1953, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204260}, {obj_id:1955, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186747}, {obj_id:1956, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186410}, {obj_id:1957, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180371}, {obj_id:1959, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186746}, {obj_id:1960, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:314579}, {obj_id:1961, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316276}, {obj_id:1962, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179253}, {obj_id:1963, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198957}, {obj_id:1964, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253315}, {obj_id:1965, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194531}, {obj_id:1966, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181919}, {obj_id:1968, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204268}, {obj_id:1969, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:1970, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156216}, {obj_id:1971, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:1973, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206972}, {obj_id:1974, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372622}, {obj_id:1975, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:1976, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:1977, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255312}, {obj_id:1978, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255070}, {obj_id:1979, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281856}, {obj_id:1980, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312870}, {obj_id:1982, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:1983, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210959}, {obj_id:1984, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:1986, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216413}, {obj_id:1987, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:1988, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207457}, {obj_id:1989, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197063}, {obj_id:1990, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202377}, {obj_id:1991, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319848}, {obj_id:1993, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177048}, {obj_id:1994, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179527}, {obj_id:1996, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:390465}, {obj_id:1997, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181650}, {obj_id:1998, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180128}, {obj_id:1999, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175288}, {obj_id:2000, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179784}, {obj_id:2001, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183026}, {obj_id:2002, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179032}, {obj_id:2003, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186850}, {obj_id:2004, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207791}, {obj_id:2005, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188599}, {obj_id:2006, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241706}, {obj_id:2007, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179781}, {obj_id:2008, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189180}, {obj_id:2010, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175346}, {obj_id:2011, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182950}, {obj_id:2012, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178932}, {obj_id:2013, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184319}, {obj_id:2014, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182003}, {obj_id:2015, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:383980}, {obj_id:2016, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175770}, {obj_id:2017, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180015}, {obj_id:2018, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219419}, {obj_id:2019, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204596}, {obj_id:2020, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181397}, {obj_id:2021, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179054}, {obj_id:2022, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156256}, {obj_id:2023, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237344}, {obj_id:2024, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209999}, {obj_id:2025, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230256}, {obj_id:2026, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188496}, {obj_id:2027, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179278}, {obj_id:2028, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192304}, {obj_id:2029, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195605}, {obj_id:2030, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183563}, {obj_id:2031, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182637}, {obj_id:2033, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:392174}, {obj_id:2035, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304600}, {obj_id:2037, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184788}, {obj_id:2038, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185565}, {obj_id:2039, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181321}, {obj_id:2040, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204506}, {obj_id:2041, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:348902}, {obj_id:2042, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222494}, {obj_id:2043, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220331}, {obj_id:2044, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181427}, {obj_id:2045, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226680}, {obj_id:2046, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192432}, {obj_id:2047, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225643}, {obj_id:2048, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174740}, {obj_id:2049, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215812}, {obj_id:2050, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196675}, {obj_id:2051, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179861}, {obj_id:2052, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204953}, {obj_id:2053, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196998}, {obj_id:2054, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179552}, {obj_id:2055, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197192}, {obj_id:2056, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187268}, {obj_id:2057, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185914}, {obj_id:2058, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205463}, {obj_id:2059, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:391976}, {obj_id:2060, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202155}, {obj_id:2061, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207183}, {obj_id:2062, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228354}, {obj_id:2063, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240497}, {obj_id:2064, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182911}, {obj_id:2065, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218028}, {obj_id:2066, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210463}, {obj_id:2067, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176755}, {obj_id:2068, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2069, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198027}, {obj_id:2070, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181248}, {obj_id:2071, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179856}, {obj_id:2072, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185425}, {obj_id:2073, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:365208}, {obj_id:2074, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189692}, {obj_id:2075, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183454}, {obj_id:2076, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238844}, {obj_id:2077, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321800}, {obj_id:2078, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186250}, {obj_id:2079, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196079}, {obj_id:2080, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332305}, {obj_id:2081, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320208}, {obj_id:2082, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251367}, {obj_id:2083, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182508}, {obj_id:2084, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300805}, {obj_id:2085, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178980}, {obj_id:2086, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178916}, {obj_id:2087, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209270}, {obj_id:2088, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184260}, {obj_id:2089, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183375}, {obj_id:2090, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240830}, {obj_id:2091, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201771}, {obj_id:2092, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192848}, {obj_id:2093, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185409}, {obj_id:2094, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185960}, {obj_id:2095, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178833}, {obj_id:2096, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184221}, {obj_id:2098, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186713}, {obj_id:2099, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215730}, {obj_id:2101, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197347}, {obj_id:2102, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193779}, {obj_id:2103, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234706}, {obj_id:2104, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179916}, {obj_id:2105, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204599}, {obj_id:2106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208576}, {obj_id:2107, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196385}, {obj_id:2108, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2109, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2110, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181778}, {obj_id:2114, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210988}, {obj_id:2115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209186}, {obj_id:2116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197363}, {obj_id:2117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223906}, {obj_id:2118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201491}, {obj_id:2119, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292238}, {obj_id:2120, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207205}, {obj_id:2122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226896}, {obj_id:2123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181523}, {obj_id:2124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213117}, {obj_id:2125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:2126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179447}, {obj_id:2127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183182}, {obj_id:2128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184816}, {obj_id:2129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200736}, {obj_id:2130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224430}, {obj_id:2132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207161}, {obj_id:2133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192675}, {obj_id:2135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385804}, {obj_id:2137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230239}, {obj_id:2153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202184}, {obj_id:2156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205408}, {obj_id:2157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206436}, {obj_id:2158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174583}, {obj_id:2162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213869}, {obj_id:2163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195408}, {obj_id:2164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203912}, {obj_id:2166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182577}, {obj_id:2167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181498}, {obj_id:2168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199791}, {obj_id:2169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184951}, {obj_id:2170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265434}, {obj_id:2171, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186761}, {obj_id:2172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180107}, {obj_id:2173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205227}, {obj_id:2174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210318}, {obj_id:2175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196533}, {obj_id:2176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180448}, {obj_id:2177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185110}, {obj_id:2178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191697}, {obj_id:2179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217620}, {obj_id:2180, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221861}, {obj_id:2181, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185962}, {obj_id:2182, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:422104}, {obj_id:2183, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190931}, {obj_id:2184, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192945}, {obj_id:2185, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179350}, {obj_id:2186, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:2187, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188846}, {obj_id:2188, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417908}, {obj_id:2189, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180199}, {obj_id:2195, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207911}, {obj_id:2203, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188121}, {obj_id:2204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196915}, {obj_id:2205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385249}, {obj_id:2209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2211, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem [2024-06-24 16:58:36.530911] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=1346] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:36.543666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:36.549123] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516548086000, start_id=1719219516548086000, end_id=1719219516548086001) [2024-06-24 16:58:36.553985] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.558274] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219516558270, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-06-24 16:58:36.563140] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=14] dump dtl interm result cost(us)(dump_cost=1847, ret=0, interm count=0, dump count=619) [2024-06-24 16:58:36.564757] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=31] clear dtl interm result cost(us)(clear_cost=1585, ret=0, gc_.expire_keys_.count()=0, dump count=619, interm count=0, clean count=0) [2024-06-24 16:58:36.567719] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=7550, avg_group_log_size=539) [2024-06-24 16:58:36.567760] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8017) [2024-06-24 16:58:36.567978] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257260-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219516567091000, start_id=1719219516567091000, end_id=1719219516567091001) [2024-06-24 16:58:36.568076] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7550) [2024-06-24 16:58:36.568137] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7550) [2024-06-24 16:58:36.568189] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=394, avg_log_submit_to_slide_time=408) [2024-06-24 16:58:36.568446] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=2757) [2024-06-24 16:58:36.568465] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=20] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13730, offset=3448364}, end_cursor:ObLogCursor{file_id=1, log_id=13731, offset=3448637}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c5c050, len:468, log_data_len:273, seq:13730, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:36.568498] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=2757) [2024-06-24 16:58:36.568538] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1611, avg_log_submit_to_slide_time=1624) [2024-06-24 16:58:36.570831] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D90B-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219516570217000, start_id=1719219516570217000, end_id=1719219516570217001) [2024-06-24 16:58:36.571792] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=19] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13731, offset=3448637}, end_cursor:ObLogCursor{file_id=1, log_id=13732, offset=3448902}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c60050, len:4291, log_data_len:265, seq:13731, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:36.578462] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.581498] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D426-0-0] [lt=21] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.581678] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D428-0-0] [lt=30] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.586270] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219516586030000, start_id=1719219516586030000, end_id=1719219516586030001) [2024-06-24 16:58:36.603460] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:36.608472] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219516608161000, start_id=1719219516608161000, end_id=1719219516608161001) [2024-06-24 16:58:36.615415] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DB7-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:36.618448] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DB8-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.620234] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=18] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:36.620848] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=27] gc stale ls task succ [2024-06-24 16:58:36.624200] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12572B7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:36.627237] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DBA-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:36.630286] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DBB-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:36.654046] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.655939] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC3-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.659297] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A3C7F-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.661093] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219516660940000, start_id=1719219516660940000, end_id=1719219516660940001) [2024-06-24 16:58:36.664018] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC5-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.665224] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:36.665212] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=407, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:36.665242] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:36.665266] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:36.665277] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:36.665285] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=8] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=481, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:36.665291] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=21, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:36.666859] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:36.666970] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:36.667173] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:36.667238] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:36.667407] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:36.667484] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:36.667587] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC8-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:36.668970] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD51-0-0] [lt=29] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:36.678517] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.680144] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DC9-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:36.686929] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1353][T1004_LockWaitM][T1004][Y0-0000000000000000-0-0] [lt=18] report RowHolderMapper summary info(count=2620, bkt_cnt=7838) [2024-06-24 16:58:36.696521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283389816832, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:36.699824] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=16] gc stale ls task succ [2024-06-24 16:58:36.712827] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=21] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:36.713942] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=23] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:36.714010] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=18] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219506800618000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:36.722400] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516722113000, start_id=1719219516722113000, end_id=1719219516722113001) [2024-06-24 16:58:36.723468] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=37676, mem_used=147661824) [2024-06-24 16:58:36.724413] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D43C-0-0] [lt=17] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:36.724522] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DD7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.727520] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DD8-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:36.730030] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=12] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:36.737262] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:36.737513] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A3D07-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516736916000, start_id=1719219516736916000, end_id=1719219516736916001) [2024-06-24 16:58:36.737554] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F0F-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219516736916000, start_id=1719219516736916001, end_id=1719219516736916002) [2024-06-24 16:58:36.737945] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96A4A-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219516736916000, start_id=1719219516736916002, end_id=1719219516736916003) [2024-06-24 16:58:36.738155] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A3D07-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=39, this=0x7f473495c280, extra_info="") [2024-06-24 16:58:36.738187] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A3D07-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=490, this=0x7f473495c4b0, extra_info="") [2024-06-24 16:58:36.738204] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A3D07-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=0, this=0x7f473495c6e0, extra_info="") [2024-06-24 16:58:36.738218] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A3D07-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=-500, this=0x7f473495c910, extra_info="") [2024-06-24 16:58:36.738228] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A3D07-0-0] [lt=10] [APPLY STAT CB TOTAL TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=29, this=0x7f473495cb40, extra_info="") [2024-06-24 16:58:36.739068] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:36.739169] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219507115876000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:36.740812] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=20] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1002, avail_memory=375809638, chunk_count_=0, avail_sort_memory_=375809638, avail_memory_=375809638) [2024-06-24 16:58:36.743762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:36.749217] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516748555000, start_id=1719219516748555000, end_id=1719219516748555001) [2024-06-24 16:58:36.749301] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=37] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:36.749341] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:36.749678] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=359, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:36.749714] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:36.749738] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:36.749768] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=424, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:36.749787] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:36.754107] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.762108] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [163815][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:36.762215] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [163815][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2024-06-24 16:58:36.764806] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221494466, support_ssl=false) [2024-06-24 16:58:36.764860] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=16] sm conn init succ(conn.sessid_=3221494466, sess.client_addr_="172.20.17.86:49508") [2024-06-24 16:58:36.764876] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=11] accept one succ(*s={this:0x7f46bf5f6030, session_id:3221494466, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:36.764957] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6030, session_id:3221494466, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:36.764976] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=16] kill and revert session(conn.sessid_=3221494466, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:36.764986] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=10] sock ref clean, do destroy(*s={this:0x7f46bf5f6030, session_id:3221494466, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:36.765032] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=44] mark session id unused(conn.sessid_=3221494466) [2024-06-24 16:58:36.765038] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=5] connection close(sessid=3221494466, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:36.778578] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.780735] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8DED-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.786493] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516786340000, start_id=1719219516786340000, end_id=1719219516786340001) [2024-06-24 16:58:36.794980] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=2035) [2024-06-24 16:58:36.794998] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=450, avg_log_submit_to_slide_time=457) [2024-06-24 16:58:36.808562] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219516808427000, start_id=1719219516808427000, end_id=1719219516808427001) [2024-06-24 16:58:36.811425] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=10] ====== check clog disk timer task ====== [2024-06-24 16:58:36.811442] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=10] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=114) [2024-06-24 16:58:36.811464] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=12] cannot_recycle_log_size statistics(cannot_recycle_log_size=53462548, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:36.823049] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:36.823099] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=33] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1233) [2024-06-24 16:58:36.825144] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=10] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=31, mem_used=49913856) [2024-06-24 16:58:36.825177] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] release old cannot free more memory [2024-06-24 16:58:36.825185] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=7] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=2, elapse_time=42, size_used=0, mem_used=47834112) [2024-06-24 16:58:36.842132] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219516842051000, start_id=1719219516842051000, end_id=1719219516842051001) [2024-06-24 16:58:36.854167] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:36.854204] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=35] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:36.854229] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.861215] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219516861016000, start_id=1719219516861016000, end_id=1719219516861016001) [2024-06-24 16:58:36.873454] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873466] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873500] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873509] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873606] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=7] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873735] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.873940] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874092] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874095] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874151] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874286] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874362] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874427] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874601] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874603] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874685] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874685] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874713] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.874819] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:36.878632] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.896812] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16483, offset=3755109}, end_cursor:ObLogCursor{file_id=1, log_id=16484, offset=3755382}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c64050, len:923, log_data_len:273, seq:16483, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:36.897054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283396108288, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:36.899016] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FC-0-0] [lt=33] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334343862533569336e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.950271661537344414e+01) [2024-06-24 16:58:36.901201] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FC-0-0] [lt=53] get number(ret=0, service_type_=0, range=1, base_id=1719219516901094000, start_id=1719219516901094000, end_id=1719219516901094001) [2024-06-24 16:58:36.901304] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FC-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9611, avg_group_log_size=640) [2024-06-24 16:58:36.901335] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FC-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9609) [2024-06-24 16:58:36.901675] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9611) [2024-06-24 16:58:36.901727] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9611) [2024-06-24 16:58:36.901763] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=396, avg_log_submit_to_slide_time=408) [2024-06-24 16:58:36.902339] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16484, offset=3755382}, end_cursor:ObLogCursor{file_id=1, log_id=16485, offset=3755647}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c68050, len:650, log_data_len:265, seq:16484, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:36.911393] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:36.912086] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=39] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:36.919932] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=17112710, clean_num=201326) [2024-06-24 16:58:36.922461] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219516922161000, start_id=1719219516922161000, end_id=1719219516922161001) [2024-06-24 16:58:36.923040] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257379-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219516922161000, start_id=1719219516922161000, end_id=1719219516922161001) [2024-06-24 16:58:36.928618] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1719219516928616, bytes: 170712939, bw: 0.020358 MB/s, add_ts: 1007617, add_bytes: 21510 [2024-06-24 16:58:36.939802] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=31] Garbage Collector is running(seq_=620, gc_interval=10000000) [2024-06-24 16:58:36.939899] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=34] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:36.939923] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] self is leader, skip it(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:36.939950] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=112) [2024-06-24 16:58:36.939969] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:36.941934] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:36.943760] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=30] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:36.943796] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=30] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:36.943821] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:36.943839] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] execute_gc cost time(ret=0, time_us=44) [2024-06-24 16:58:36.943850] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=9] ObSafeDestroyHandler start process [2024-06-24 16:58:36.943850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:36.945054] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E28-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:36.947188] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB96BF9-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.949448] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219516948551000, start_id=1719219516948551000, end_id=1719219516948551001) [2024-06-24 16:58:36.952866] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E2A-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:36.954227] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.954689] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=15] ====== tenant freeze timer task ====== [2024-06-24 16:58:36.954750] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:666) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=28] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=10) [2024-06-24 16:58:36.954776] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:572) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=22] TxData Memory Statistic : (Tenant Total Memory(MB)=1024, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=10, Freeze TxData Trigger Memory(MB)=20, Total TxDataTable Hold Memory(MB)=16, Total TxDataTable Memory Limit(MB)=204) [2024-06-24 16:58:36.955850] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E2B-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:36.958858] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E2C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:36.964979] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:36.965014] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1913, avg_group_log_size=191) [2024-06-24 16:58:36.965038] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1913) [2024-06-24 16:58:36.965058] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:36.965091] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:36.965403] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=373, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:36.965448] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=19] [APPLY STAT CB APPEND COST TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=37, this=0x7f46d7ab8280, extra_info="") [2024-06-24 16:58:36.965477] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=421, this=0x7f46d7ab84b0, extra_info="") [2024-06-24 16:58:36.965493] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=0, this=0x7f46d7ab86e0, extra_info="") [2024-06-24 16:58:36.965510] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=16] [APPLY STAT CB EXECUTE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-429, this=0x7f46d7ab8910, extra_info="") [2024-06-24 16:58:36.965523] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=29, this=0x7f46d7ab8b40, extra_info="") [2024-06-24 16:58:36.973751] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:36.978693] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:36.986599] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219516986549000, start_id=1719219516986549000, end_id=1719219516986549001) [2024-06-24 16:58:36.988928] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E35-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:36.991995] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E36-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:36.996347] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E38-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:36.999065] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:36.999165] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:36.999248] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [162957][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=46] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f4841ffc2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:36.999349] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:36.999409] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:36.999569] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:36.999650] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:36.999744] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3B-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:37.001713] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:787) [163649][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=39] ps cache evict(tenant_id=1, stmt_id_map_.size()=12, stmt_info_map_.size()=12, op.get_used_size()=26439, get_mem_high()=410706180, expired_stmt_ids.count()=0, closed_stmt_ids.count()=12) [2024-06-24 16:58:37.002706] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=30] gc stale ls task succ [2024-06-24 16:58:37.008665] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219517007690000, start_id=1719219517007690000, end_id=1719219517007690001) [2024-06-24 16:58:37.012317] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E3C-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.017040] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1004) [2024-06-24 16:58:37.017089] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1004, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:37.017108] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=16] end lib cache evict(tenant_id=1004, cache_evict_num=0, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:37.017127] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=17] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:37.026173] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=497, alloc_obj_list=[{obj_id:35, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:39, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:40, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184250}, {obj_id:41, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:43, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:45, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:53, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175298}, {obj_id:84, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174332}, {obj_id:145, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:146, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:147, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:148, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:151, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:152, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:153, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:154, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:155, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:156, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:157, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:158, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:159, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:160, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198897}, {obj_id:161, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:162, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:163, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:164, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:165, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:166, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:167, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:168, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:169, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:170, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:171, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:172, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:173, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:174, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:175, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:176, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:177, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175451}, {obj_id:178, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181217}, {obj_id:179, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:180, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:181, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:182, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235894}, {obj_id:183, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209782}, {obj_id:184, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230576}, {obj_id:185, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:186, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:187, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:188, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:189, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:190, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:191, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:192, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:193, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:195, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:196, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:197, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:198, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:199, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:200, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:201, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:202, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:203, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:204, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:205, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:206, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:207, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:208, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:209, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:210, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:211, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:212, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:213, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:214, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:215, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:216, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299219}, {obj_id:217, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236649}, {obj_id:218, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:219, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184514}, {obj_id:220, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:221, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:222, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:223, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180301}, {obj_id:224, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:225, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:226, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:227, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:228, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183169}, {obj_id:229, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:230, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:232, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:235, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:236, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:237, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:238, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:239, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:240, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:241, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:242, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188148}, {obj_id:243, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:244, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:245, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:246, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:247, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:248, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:249, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:250, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:251, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:252, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:253, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:254, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:255, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206580}, {obj_id:256, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208496}, {obj_id:257, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:258, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308540}, {obj_id:260, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207652}, {obj_id:261, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:262, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172752}, {obj_id:263, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:264, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:265, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:266, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:267, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:268, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:269, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:270, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:271, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:272, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157105}, {obj_id:273, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175095}, {obj_id:274, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176760}, {obj_id:275, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185989}, {obj_id:276, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:277, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:278, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:279, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419083}, {obj_id:280, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417152}, {obj_id:283, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239831}, {obj_id:284, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242976}, {obj_id:285, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256105}, {obj_id:286, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256298}, {obj_id:287, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:288, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:289, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:290, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:291, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:292, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:293, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:294, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231047}, {obj_id:295, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:296, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:297, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:298, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:299, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215340}, {obj_id:300, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:301, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:302, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:303, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:304, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:307, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:308, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:311, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:375291}, {obj_id:312, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:384468}, {obj_id:313, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325700}, {obj_id:314, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:334948}, {obj_id:315, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227240}, {obj_id:316, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268192}, {obj_id:317, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200156}, {obj_id:318, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206516}, {obj_id:335, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182820}, {obj_id:349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191406}, {obj_id:352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:362, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204485}, {obj_id:363, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224055}, {obj_id:366, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185366}, {obj_id:367, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195268}, {obj_id:368, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:375, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:376, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:379, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:380, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234934}, {obj_id:381, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:382, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:383, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:384, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218544}, {obj_id:385, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:386, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:387, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:388, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:391, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189184}, {obj_id:392, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201018}, {obj_id:395, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191754}, {obj_id:396, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204870}, {obj_id:399, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:400, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:403, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:404, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:407, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:408, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199110}, {obj_id:411, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:412, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:425, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:426, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:427, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:428, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:429, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:430, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217209}, {obj_id:431, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:432, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:433, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:434, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:437, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201929}, {obj_id:438, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220211}, {obj_id:441, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186646}, {obj_id:442, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197186}, {obj_id:449, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187051}, {obj_id:450, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236235}, {obj_id:451, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291681}, {obj_id:452, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229118}, {obj_id:453, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200168}, {obj_id:454, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219871}, {obj_id:455, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201375}, {obj_id:456, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291677}, {obj_id:457, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181926}, {obj_id:458, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201455}, {obj_id:461, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198111}, {obj_id:462, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214476}, {obj_id:473, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212131}, {obj_id:474, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235568}, {obj_id:489, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203200}, {obj_id:490, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222135}, {obj_id:493, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:494, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:497, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252923}, {obj_id:498, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296972}, {obj_id:509, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:510, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237536}, {obj_id:511, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292049}, {obj_id:512, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229486}, {obj_id:513, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200544}, {obj_id:514, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221206}, {obj_id:515, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201791}, {obj_id:516, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292045}, {obj_id:517, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182278}, {obj_id:518, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201839}, {obj_id:521, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263105}, {obj_id:522, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312324}, {obj_id:527, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269484}, {obj_id:528, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321943}, {obj_id:537, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254176}, {obj_id:538, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:298902}, {obj_id:551, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251638}, {obj_id:552, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295058}, {obj_id:555, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223603}, {obj_id:556, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252824}, {obj_id:573, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190308}, {obj_id:574, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238837}, {obj_id:575, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292385}, {obj_id:576, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229822}, {obj_id:577, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200872}, {obj_id:578, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222549}, {obj_id:579, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202111}, {obj_id:580, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292381}, {obj_id:581, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182630}, {obj_id:582, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202159}, {obj_id:587, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:588, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:611, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205738}, {obj_id:612, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225979}, {obj_id:625, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274568}, {obj_id:626, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329621}, {obj_id:643, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:644, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:645, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206454}, {obj_id:646, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:647, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:648, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:649, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197356}, {obj_id:650, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178512}, {obj_id:651, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198928}, {obj_id:652, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199105}, {obj_id:653, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156378}, {obj_id:654, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157162}, {obj_id:655, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176121}, {obj_id:656, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:657, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:307685}, {obj_id:658, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:660, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312830}, {obj_id:661, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:662, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:663, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:664, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202402}, {obj_id:665, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:666, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216429}, {obj_id:667, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:668, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157107}, {obj_id:669, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176570}, {obj_id:670, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176412}, {obj_id:672, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:673, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156195}, {obj_id:674, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:676, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:677, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372653}, {obj_id:678, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:679, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:680, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255326}, {obj_id:681, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255084}, {obj_id:682, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281876}, {obj_id:683, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319873}, {obj_id:684, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209231}, {obj_id:700, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192790}, {obj_id:701, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257630}, {obj_id:702, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234000}, {obj_id:731, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200128}, {obj_id:733, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:409897}, {obj_id:734, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:400862}, {obj_id:736, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175113}, {obj_id:737, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184566}, {obj_id:742, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175296}, {obj_id:743, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181792}, {obj_id:746, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185582}, {obj_id:747, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:797, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200312}, {obj_id:798, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198098}, {obj_id:799, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288253}, {obj_id:800, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:801, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200393}, {obj_id:802, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213250}, {obj_id:803, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328028}, {obj_id:804, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198852}, {obj_id:805, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:806, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:807, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:808, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:809, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174410}, {obj_id:815, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173948}, {obj_id:825, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185181}, {obj_id:828, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238944}, {obj_id:832, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:833, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:834, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:835, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:836, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188748}, {obj_id:837, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207583}, {obj_id:838, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220441}, {obj_id:839, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189684}, {obj_id:840, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183154}, {obj_id:841, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246969}, {obj_id:842, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249608}, {obj_id:843, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231450}, {obj_id:844, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180118}, {obj_id:845, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268752}, {obj_id:846, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270542}, {obj_id:847, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270227}, {obj_id:848, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273208}, {obj_id:849, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257627}, {obj_id:850, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273232}, {obj_id:851, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254489}, {obj_id:852, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269717}, {obj_id:853, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175231}, {obj_id:854, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181662}, {obj_id:855, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177134}, {obj_id:861, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177715}, {obj_id:869, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187847}, {obj_id:879, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200764}, {obj_id:880, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200755}, {obj_id:930, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:466821}, {obj_id:931, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:932, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296709}, {obj_id:933, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318958}, {obj_id:934, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312747}, {obj_id:935, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325200}, {obj_id:936, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217553}, {obj_id:937, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281577}, {obj_id:938, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189394}, {obj_id:939, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:641561}, {obj_id:940, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:244732}, {obj_id:941, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232660}, {obj_id:942, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:943, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:944, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217413}, {obj_id:945, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189522}, {obj_id:946, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232546}, {obj_id:1073, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246494}, {obj_id:1140, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:378647}, {obj_id:1141, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306509}, {obj_id:1142, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1143, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:1144, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198777}, {obj_id:1194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247404}, {obj_id:1320, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:438066}, {obj_id:1321, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260903}, {obj_id:1322, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206816}, {obj_id:1323, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193061}, {obj_id:1324, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178317}, {obj_id:1325, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182140}, {obj_id:1326, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174724}, {obj_id:1327, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195853}, {obj_id:1328, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184944}, {obj_id:1329, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201089}, {obj_id:1330, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209476}, {obj_id:1331, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:170609}, {obj_id:1332, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171169}, {obj_id:1333, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203806}, {obj_id:1334, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200651}, {obj_id:1336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195256}, {obj_id:1337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203334}, {obj_id:1338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198057}, {obj_id:1339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192160}, {obj_id:1340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194971}, {obj_id:1341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196164}, {obj_id:1342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198958}, {obj_id:1343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197940}, {obj_id:1344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200683}, {obj_id:1345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197036}, {obj_id:1346, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199801}, {obj_id:1347, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204590}, {obj_id:1348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197459}, {obj_id:1349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207323}, {obj_id:1350, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200262}, {obj_id:1351, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197164}, {obj_id:1353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199224}, {obj_id:1354, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201933}, {obj_id:1355, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202018}, {obj_id:1356, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206006}, {obj_id:1357, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204664}, {obj_id:1358, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205068}, {obj_id:1359, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208689}, {obj_id:1360, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207750}, {obj_id:1361, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209040}, {obj_id:13 [2024-06-24 16:58:37.028019] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=1842] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:37.028330] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1453][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=39] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:37.034824] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 384.50) [2024-06-24 16:58:37.034868] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:37.035028] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 409.50) [2024-06-24 16:58:37.035045] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:37.035081] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035119] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035148] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035162] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035176] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035204] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035214] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035229] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035245] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035273] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035288] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035302] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:37.035437] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:37.035481] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=28] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:37.035515] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348770635, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:37.051017] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E49-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.053868] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E4A-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.054290] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.054336] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=29] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:37.061279] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219517060442000, start_id=1719219517060442000, end_id=1719219517060442001) [2024-06-24 16:58:37.073047] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:37.073106] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:37.073136] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:37.073164] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:37.073514] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=399, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:37.073527] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=481, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:37.073554] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:37.073564] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:37.073593] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:37.073649] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=499, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:37.073670] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=31, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:37.073705] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=7, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:37.073720] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=578, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:37.073734] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=29, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:37.078748] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.079331] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:37.079375] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=28] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:37.079395] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1232) [2024-06-24 16:58:37.095502] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=608, mem_used=2079744) [2024-06-24 16:58:37.096650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.096711] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.096711] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.096816] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.096975] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.096993] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097161] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097165] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097216] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097339] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097343] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097395] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097396] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097508] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097570] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097649] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097659] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097720] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097733] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097731] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097755] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097770] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097770] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097818] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097826] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.097887] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098178] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098246] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098257] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098452] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098486] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098556] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098660] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.098942] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.099125] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.099229] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.104087] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E5C-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:37.113529] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=21] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:37.120423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283385622528, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:37.122693] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219517121637000, start_id=1719219517121637000, end_id=1719219517121637001) [2024-06-24 16:58:37.133542] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=31] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:37.133661] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:37.143923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:37.146636] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D9-0-0] [lt=32] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:37.146673] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8D9-0-0] [lt=34] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:37.148441] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F4-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:37.148479] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F4-0-0] [lt=35] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:37.149779] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219517149039000, start_id=1719219517149039000, end_id=1719219517149039001) [2024-06-24 16:58:37.152945] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:37.153141] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B5-0-0] [lt=27] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219524521932000, latest_log_ts:{val:1719219507943313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:37.153282] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B5-0-0] [lt=135] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:37.154346] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.165137] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:37.165501] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:37.165518] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:37.165527] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=9] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=437, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:37.165533] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=20, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:37.175107] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=17] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:37.178824] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:37.178851] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:37.178870] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.186727] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1719219517186046000, start_id=1719219517186046000, end_id=1719219517186046001) [2024-06-24 16:58:37.196975] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:37.197203] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B5-0-0] [lt=31] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219514838441000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219523569925000, latest_log_ts:{val:1719219507324493001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:37.197619] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B5-0-0] [lt=151] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219516842051003, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219514838441000, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:37.197763] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B5-0-0] [lt=138] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:37.201438] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:37.208763] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219517208244000, start_id=1719219517208244000, end_id=1719219517208244001) [2024-06-24 16:58:37.209310] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:37.229775] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1387][T1004_ArcSender][T1004][YB42AC141156-00061B9D9370C0E5-0-0] [lt=18][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:37.238613] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:37.238653] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:37.238991] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4618) [2024-06-24 16:58:37.239044] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4618) [2024-06-24 16:58:37.239086] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:37.239105] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=433, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:37.239128] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:37.254404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.260619] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC129C3-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:37.261433] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219517261057000, start_id=1719219517261057000, end_id=1719219517261057001) [2024-06-24 16:58:37.263943] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E95-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:37.265055] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A5-0-0] [lt=55][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:37.265085] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A5-0-0] [lt=28][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:37.273160] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1790, avg_group_log_size=198) [2024-06-24 16:58:37.273193] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1790) [2024-06-24 16:58:37.273228] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=6704, avg_group_log_size=515) [2024-06-24 16:58:37.273247] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=6704) [2024-06-24 16:58:37.273366] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E96-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.273592] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1790) [2024-06-24 16:58:37.273637] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=492, avg_log_submit_to_slide_time=505) [2024-06-24 16:58:37.276160] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E97-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.278841] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.279005] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8E98-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:37.290166] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:37.290378] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=45] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:37.290403] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:37.290471] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=24] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1650614272, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5865578496, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:37.290563] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:37.290584] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=416414, drift_size_=0, pre_drift_size=12240224, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:37.290654] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=20] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:37.290792] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:37.290810] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=17] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:37.290873] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=20] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:37.291050] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:37.291070] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:37.300787] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2024-06-24 16:58:37.300824] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:37.300855] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=70287713, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:37.302854] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA2-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:37.305712] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA3-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:37.310159] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA5-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.312979] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:37.313079] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:37.313273] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:37.313247] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=38] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:37.313335] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:37.313493] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:37.313564] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:37.313668] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA7-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:37.320918] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283389816832, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:37.322819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219517322370000, start_id=1719219517322370000, end_id=1719219517322370001) [2024-06-24 16:58:37.322901] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=4618, avg_group_log_size=461) [2024-06-24 16:58:37.322932] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4618) [2024-06-24 16:58:37.324646] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2024-06-24 16:58:37.325752] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111779, mem_used=262047744) [2024-06-24 16:58:37.325878] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EA8-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.333144] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A40C7-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219517332916000, start_id=1719219517332916000, end_id=1719219517332916001) [2024-06-24 16:58:37.333316] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F54-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219517332916000, start_id=1719219517332916001, end_id=1719219517332916002) [2024-06-24 16:58:37.342564] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:37.342904] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219517342441000, start_id=1719219517342441000, end_id=1719219517342441001) [2024-06-24 16:58:37.342945] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:37.343399] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=17] submit log success(service_type_=0, last_id=1719219533569925000, limited_id=1719219533569925000) [2024-06-24 16:58:37.343417] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=18] submit log with lock success(service_type_=0, last_id=1719219533569925000, limited_id=1719219533569925000) [2024-06-24 16:58:37.343444] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=13] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=360, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:37.343827] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1719219533569925000, latest_scn={val:1719219517342441001, v:0}, *this={tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219514838441000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:37.343898] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=70] handle submit callback(service_type_=0, success=true, used_ts=499, log_ts={val:1719219517342441001, v:0}, limited_id=1719219533569925000) [2024-06-24 16:58:37.343918] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:37.343935] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:37.347640] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1003, min_version={val:1719219517149039000, v:0}, base_version={val:1719219516948551000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219517149039000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219517347611, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:37.349717] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=48] get number(ret=0, service_type_=0, range=1, base_id=1719219517348785000, start_id=1719219517348785000, end_id=1719219517348785001) [2024-06-24 16:58:37.352300] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82100000, replace_num=100000) [2024-06-24 16:58:37.352323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:37.354462] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.365243] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:37.365277] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:37.365781] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EB4-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.368660] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EB5-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.378899] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.385996] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219517385766000, start_id=1719219517385766000, end_id=1719219517385766001) [2024-06-24 16:58:37.408860] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219517407904000, start_id=1719219517407904000, end_id=1719219517407904001) [2024-06-24 16:58:37.408936] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:37.408974] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:37.409360] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=318, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:37.409396] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:37.409424] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:37.409454] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=377, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:37.409472] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=24, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:37.409567] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1719219517208244000, v:0}, new_max_version={val:1719219517208244000, v:0}, last_min_version={val:1719219517007690000, v:0}, last_max_version={val:1719219517007690000, v:0}, total_time_us=2683, delta_us=201322) [2024-06-24 16:58:37.409597] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1719219517208244000, v:0}, min_version={val:1719219517208244000, v:0}, max_version={val:1719219517208244000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:37.418013] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8EC8-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:37.420199] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=129695, mem_used=326519808) [2024-06-24 16:58:37.454484] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.459576] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1719219517124809000, v:0}, base_version={val:1719219516932689000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219517124809000, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219517459562, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:37.460404] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163799][T1002_TntTransf][T1002][YB42AC141156-00061B9D9190C34F-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:37.461667] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219517461629000, start_id=1719219517461629000, end_id=1719219517461629001) [2024-06-24 16:58:37.470954] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163796][T1002_TntTransf][T1002][YB42AC141156-00061B9D9160C34F-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:37.478962] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.480605] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=20] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:37.484414] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:37.484455] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=24] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1253) [2024-06-24 16:58:37.513917] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163798][T1002_TntTransf][T1002][YB42AC141156-00061B9D9180C34F-0-0] [lt=31] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:37.514370] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163797][T1002_TntTransf][T1002][YB42AC141156-00061B9D9170C34F-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:37.521389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283385622528, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:37.522863] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219517522657000, start_id=1719219517522657000, end_id=1719219517522657001) [2024-06-24 16:58:37.523341] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=359, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:37.523377] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:37.530961] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC08-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103413622325, cache_obj->added_lc()=false, cache_obj->get_object_id()=9358, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:37.549788] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219517549012000, start_id=1719219517549012000, end_id=1719219517549012001) [2024-06-24 16:58:37.552400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:37.554543] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.565766] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1342) [2024-06-24 16:58:37.565820] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=5] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=382, avg_log_submit_to_slide_time=390) [2024-06-24 16:58:37.565897] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1719219517565893, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-06-24 16:58:37.568302] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=9865, avg_group_log_size=580) [2024-06-24 16:58:37.568330] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9865) [2024-06-24 16:58:37.568665] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9865) [2024-06-24 16:58:37.573808] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8758) [2024-06-24 16:58:37.573848] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=8758) [2024-06-24 16:58:37.573885] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=50, avg_log_gen_to_submit_time=59, avg_log_submit_to_flush_time=393, avg_log_submit_to_slide_time=407) [2024-06-24 16:58:37.574682] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=14] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13732, offset=3448902}, end_cursor:ObLogCursor{file_id=1, log_id=13733, offset=3449175}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c6c050, len:4026, log_data_len:273, seq:13732, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:37.576054] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4226-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:37.576819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D90C-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219517576437000, start_id=1719219517576437000, end_id=1719219517576437001) [2024-06-24 16:58:37.577214] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=10990) [2024-06-24 16:58:37.577251] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=352, avg_log_submit_to_slide_time=362) [2024-06-24 16:58:37.577774] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=26] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13733, offset=3449175}, end_cursor:ObLogCursor{file_id=1, log_id=13734, offset=3449440}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c70050, len:3753, log_data_len:265, seq:13733, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:37.578886] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F01-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:37.579020] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.584319] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F03-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.585756] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F79-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219517584861000, start_id=1719219517584861000, end_id=1719219517584861001) [2024-06-24 16:58:37.586832] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219517585919000, start_id=1719219517585919000, end_id=1719219517585919001) [2024-06-24 16:58:37.587165] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F04-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.590031] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F05-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:37.597374] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4261-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219517596470000, start_id=1719219517596470000, end_id=1719219517596470001) [2024-06-24 16:58:37.608946] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219517608051000, start_id=1719219517608051000, end_id=1719219517608051001) [2024-06-24 16:58:37.612390] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F0D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:37.615227] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F0E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:37.619771] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F10-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.620353] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:37.620903] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:37.622563] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:37.622680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:37.622868] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:37.622928] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:37.623080] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:37.623150] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:37.623245] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F12-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:37.623298] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=26][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:37.635306] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F13-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.639243] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=398, avg_log_submit_to_slide_time=411) [2024-06-24 16:58:37.654601] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.661716] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219517660914000, start_id=1719219517660914000, end_id=1719219517660914001) [2024-06-24 16:58:37.665788] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=356, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:37.665816] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:37.665828] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:37.665853] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=411, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:37.665873] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:37.672577] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F21-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.675330] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F22-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.679079] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.689145] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:60056, max_lsn:32431705, max_scn:{val:1719219517596470000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:32431705}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:0}}, last_submit_lsn:{lsn:32431583}, last_submit_end_lsn:{lsn:32431705}, last_submit_log_id:60056, last_submit_log_pid:1, max_flushed_lsn:{lsn:32431583}, max_flushed_end_lsn:{lsn:32431705}, max_flushed_log_pid:1, committed_end_lsn:{lsn:32431705}, last_slide_log_id:60056, last_slide_scn:{val:1719219517596470000, v:0}, last_slide_lsn:{lsn:32431583}, last_slide_end_lsn:{lsn:32431705}, last_slide_log_pid:1, last_slide_log_accum_checksum:3652102919, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4753cb2530}, [StateMgr]={this:0x7f4753cb62b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:60057, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213336021808, palf_role_change_cb:0x7f4753cbccb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4753cb3c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/meta", dir_fd:670, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f4753cb8478, flashback_version:0}, log_storage:{log_tail:{lsn:32431705}, readable_log_tail:{lsn:32431705}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/log", dir_fd:671, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:34673063, block_header_serialize_buf_:0x7f4753cba138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213336021452, this:0x7f4753cb69f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213336022204, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4753cb6430}) [2024-06-24 16:58:37.689483] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=333] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219517673788, last_flushed_end_lsn:{lsn:32431705}}]) [2024-06-24 16:58:37.689509] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=60057, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219517673788, last_flushed_end_lsn:{lsn:32431705}}]) [2024-06-24 16:58:37.699887] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:37.714478] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:37.721869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283387719680, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:37.722295] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:37.722323] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:37.722355] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=103049341, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:37.722537] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2024-06-24 16:58:37.722979] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219517722225000, start_id=1719219517722225000, end_id=1719219517722225001) [2024-06-24 16:58:37.723638] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=41503, mem_used=153901056) [2024-06-24 16:58:37.724216] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F36-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:37.730103] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=13] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:37.743228] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=34] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:37.749884] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219517749716000, start_id=1719219517749716000, end_id=1719219517749716001) [2024-06-24 16:58:37.749958] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:37.749991] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:37.750342] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=344, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:37.750369] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:37.750398] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:37.750415] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=407, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:37.750430] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:37.752480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:37.754650] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.765870] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=2041) [2024-06-24 16:58:37.766138] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1342) [2024-06-24 16:58:37.779138] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.784971] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=31] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1004, min_version={val:1719219517342441002, v:0}, base_version={val:1719219517342441000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219517342441002, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219517784956, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:37.786978] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1719219517786718000, start_id=1719219517786718000, end_id=1719219517786718001) [2024-06-24 16:58:37.809033] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219517808913000, start_id=1719219517808913000, end_id=1719219517808913001) [2024-06-24 16:58:37.825273] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=27, mem_used=49913856) [2024-06-24 16:58:37.825297] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=17] release old cannot free more memory [2024-06-24 16:58:37.825306] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=34, size_used=0, mem_used=49913856) [2024-06-24 16:58:37.838242] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=17] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:37.838279] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=22] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:37.838300] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1250) [2024-06-24 16:58:37.843832] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219517843757000, start_id=1719219517843757000, end_id=1719219517843757001) [2024-06-24 16:58:37.843910] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] gts statistics(tenant_id=1003, gts_rpc_cnt=10, get_gts_cache_cnt=394, get_gts_with_stc_cnt=66, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:37.854707] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.856579] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=20] current monitor number(seq_=-1) [2024-06-24 16:58:37.861959] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219517861723000, start_id=1719219517861723000, end_id=1719219517861723001) [2024-06-24 16:58:37.865936] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1226) [2024-06-24 16:58:37.865970] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=390, avg_log_submit_to_slide_time=398) [2024-06-24 16:58:37.873650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873694] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873739] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873776] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873843] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873949] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.873951] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874404] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874468] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874477] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874476] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=6] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874540] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874544] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874659] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874675] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874699] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874702] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.874864] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.875050] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:37.876555] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A444E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:37.879194] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.879273] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F6E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:37.884795] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F70-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.887524] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F71-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.890320] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F72-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:37.896696] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F92-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:37.896900] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F92-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:37.897274] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F92-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:37.897597] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F92-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:37.897818] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073F92-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:37.906558] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16485, offset=3755647}, end_cursor:ObLogCursor{file_id=1, log_id=16486, offset=3755920}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c74050, len:385, log_data_len:273, seq:16485, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:37.906764] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2024-06-24 16:58:37.907026] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5C9-0-0] [lt=20] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:37.907165] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5C9-0-0] [lt=133] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:37.908651] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FD-0-0] [lt=30] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334374136924743652e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.949462451897566950e+01) [2024-06-24 16:58:37.910689] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FD-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=6763, avg_group_log_size=563) [2024-06-24 16:58:37.910726] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FD-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7760) [2024-06-24 16:58:37.910754] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FD-0-0] [lt=25] submit log success(service_type_=0, last_id=1719219534521932000, limited_id=1719219534521932000) [2024-06-24 16:58:37.910772] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FD-0-0] [lt=17] submit log with lock success(service_type_=0, last_id=1719219534521932000, limited_id=1719219534521932000) [2024-06-24 16:58:37.910815] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FD-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219517910315000, start_id=1719219517910315000, end_id=1719219517910315001) [2024-06-24 16:58:37.911021] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=6763) [2024-06-24 16:58:37.911071] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=6763) [2024-06-24 16:58:37.911136] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=378, avg_log_submit_to_slide_time=392) [2024-06-24 16:58:37.911157] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=25] update id meta(ret=0, service_type=0, limited_id=1719219534521932000, latest_scn={val:1719219517910315001, v:0}, *this={tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:37.911218] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=60] handle submit callback(service_type_=0, success=true, used_ts=464, log_ts={val:1719219517910315001, v:0}, limited_id=1719219534521932000) [2024-06-24 16:58:37.911234] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=15] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:37.911250] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=15] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:37.911443] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:37.911896] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219517911372000, start_id=1719219517911372000, end_id=1719219517911372001) [2024-06-24 16:58:37.914448] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F7A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:37.914674] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=33] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16486, offset=3755920}, end_cursor:ObLogCursor{file_id=1, log_id=16487, offset=3756185}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c78050, len:4208, log_data_len:265, seq:16486, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:37.917300] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F7C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:37.921864] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F7E-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.922343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283385622528, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:37.923045] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219517922942000, start_id=1719219517922942000, end_id=1719219517922942001) [2024-06-24 16:58:37.924459] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:37.924554] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:37.924727] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:37.924781] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:37.924912] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:37.924974] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:37.925055] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1073FA0-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:37.936233] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1719219517936231, bytes: 170732579, bw: 0.018589 MB/s, add_ts: 1007615, add_bytes: 19640 [2024-06-24 16:58:37.937594] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F80-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:37.949196] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219517948279000, start_id=1719219517948279000, end_id=1719219517948279001) [2024-06-24 16:58:37.952559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:37.954766] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.965663] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:37.965706] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1226, avg_group_log_size=122) [2024-06-24 16:58:37.965736] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1226) [2024-06-24 16:58:37.965756] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:37.965791] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:37.966098] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=348, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:37.973922] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1912) [2024-06-24 16:58:37.975663] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F8E-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:37.978459] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8F8F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:37.979254] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:37.987047] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219517986349000, start_id=1719219517986349000, end_id=1719219517986349001) [2024-06-24 16:58:37.989312] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=41] LogLoopThread round_cost_time(us)(round_cost_time=13) [2024-06-24 16:58:37.990218] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1971][T1004_TTLTablet][T1004][YB42AC141156-00061B9D9A50C34A-0-0] [lt=43] finish reload tenant task(local_tenant_task_={tenant_id:1004, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:37.996873] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A45F6-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:37.996996] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A45F6-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:37.999962] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A45FB-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:38.002769] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=27] gc stale ls task succ [2024-06-24 16:58:38.009163] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219518008510000, start_id=1719219518008510000, end_id=1719219518008510001) [2024-06-24 16:58:38.027989] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FA2-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:38.037174] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 350.50) [2024-06-24 16:58:38.037204] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:38.037317] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 1482.50) [2024-06-24 16:58:38.037333] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:38.037366] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037385] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037400] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037414] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037428] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037447] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037461] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037474] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037489] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037502] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037514] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037527] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037541] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037555] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037571] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.037585] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:38.041900] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] [COMPACTION DAG STATUS] (start_time=1719219508040102, end_time=1719219518041896, dag_status={}) [2024-06-24 16:58:38.041937] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.041960] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.041977] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.041996] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.042008] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.042023] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.042034] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.042049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.042060] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:38.042072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042075] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:38.042102] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042116] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042133] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042149] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042166] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042182] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042198] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042214] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042230] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042246] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042262] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042279] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042295] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042311] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042322] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:38.042334] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042350] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042366] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042409] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042425] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042421] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:38.042442] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042462] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042481] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042497] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042516] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:38.042530] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042566] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042582] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042598] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042614] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042655] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=41] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042677] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:38.042692] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042725] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042758] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042774] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042839] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042855] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042872] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042904] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042932] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:38.042942] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042959] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042975] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.042995] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.043011] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.043028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.043030] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:38.043044] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.043063] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.043080] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:38.043096] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:38.043110] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:38.043113] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:38.043126] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:38.043138] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:38.043150] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:38.043160] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:38.043171] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:38.043183] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:38.043195] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:38.043207] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:38.043220] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:38.043344] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:38.043433] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:38.043572] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:38.043655] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:38.043844] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:38.043926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:38.044001] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:38.044113] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:38.044285] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:38.044360] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:38.044432] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:38.044506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:38.044640] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:38.044716] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:38.044874] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:38.044956] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4641-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:38.049194] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC09-0-0] [lt=32][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103414140566, cache_obj->added_lc()=false, cache_obj->get_object_id()=9359, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:38.050390] WDIAG get_refactored (ob_hashtable.h:1102) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC0B-0-0] [lt=22][errcode=-4201] hashtable not init [2024-06-24 16:58:38.050403] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC0B-0-0] [lt=12][errcode=-4016] get cursor info failed(cursor_id=1150, get_sessid()=3221489125) [2024-06-24 16:58:38.050530] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB4C-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1719219518049538000, start_id=1719219518049538000, end_id=1719219518049538001) [2024-06-24 16:58:38.054457] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:38.054823] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.061902] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219518061123000, start_id=1719219518061123000, end_id=1719219518061123001) [2024-06-24 16:58:38.073739] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:38.073772] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:38.073800] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:38.073821] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:38.074167] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=351, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:38.074169] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=381, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:38.074197] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:38.074204] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:38.074223] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:38.074252] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=435, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:38.074271] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=27, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:38.074298] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:38.074313] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=472, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:38.074331] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:38.079313] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.095342] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=45] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:74498, max_lsn:57975216, max_scn:{val:1719219517843757002, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:57975216}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16032176}}, last_submit_lsn:{lsn:57975094}, last_submit_end_lsn:{lsn:57975216}, last_submit_log_id:74498, last_submit_log_pid:1, max_flushed_lsn:{lsn:57975094}, max_flushed_end_lsn:{lsn:57975216}, max_flushed_log_pid:1, committed_end_lsn:{lsn:57975216}, last_slide_log_id:74498, last_slide_scn:{val:1719219517843757002, v:0}, last_slide_lsn:{lsn:57975094}, last_slide_end_lsn:{lsn:57975216}, last_slide_log_pid:1, last_slide_log_accum_checksum:4094021393, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d2f88530}, [StateMgr]={this:0x7f46d2f8c2b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:74499, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213376431572, palf_role_change_cb:0x7f46d2f92cb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d2f89c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213369678630002, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1719213369678630001, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/meta", dir_fd:689, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d2f8e478, flashback_version:0}, log_storage:{log_tail:{lsn:57975216}, readable_log_tail:{lsn:57975216}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1719213369678630002, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/log", dir_fd:690, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:9129552, block_header_serialize_buf_:0x7f46d2f90138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213376431519, this:0x7f46d2f8c9f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213376432460, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d2f8c430}) [2024-06-24 16:58:38.095682] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=65] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=646, mem_used=2079744) [2024-06-24 16:58:38.095718] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=371] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219518066096, last_flushed_end_lsn:{lsn:57975216}}]) [2024-06-24 16:58:38.095743] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=21] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=74499, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219518066096, last_flushed_end_lsn:{lsn:57975216}}]) [2024-06-24 16:58:38.096631] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.096640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.096682] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.096697] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.096719] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.096817] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097080] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097157] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097169] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097165] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097203] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097214] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097393] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097453] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097634] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097633] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097658] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097674] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097772] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097838] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097881] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.097950] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098015] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098018] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098113] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098218] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098304] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098371] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098373] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098599] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098638] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.098944] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.111506] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:38.111531] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:38.111557] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=13] cannot_recycle_log_size statistics(cannot_recycle_log_size=73542174, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:38.113390] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163032][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1E-0-0] [lt=28] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:38.113423] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163032][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1E-0-0] [lt=25] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=46) [2024-06-24 16:58:38.115734] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:38.122829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283377233920, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:38.123172] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219518123122000, start_id=1719219518123122000, end_id=1719219518123122001) [2024-06-24 16:58:38.133774] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=20] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:38.138095] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:38.138337] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:38.138436] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:38.138534] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:38.138710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:38.138967] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:38.139070] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:38.139161] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:38.139399] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:38.139491] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:38.139645] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:38.139726] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:38.139924] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:38.140008] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:38.140085] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:38.140205] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:38.140386] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:38.140469] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:38.140546] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:38.140639] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:38.140771] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:38.140853] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:38.141011] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:38.141095] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A46D6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:38.148599] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DA-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:38.148651] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DA-0-0] [lt=48] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:38.149301] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219518148389000, start_id=1719219518148389000, end_id=1719219518148389001) [2024-06-24 16:58:38.150381] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F5-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:38.150415] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F5-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:38.152648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:38.154883] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.165795] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:38.166129] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:38.166153] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:38.166178] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=406, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:38.166195] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=25, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:38.172333] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107400B-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:38.172715] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107400B-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:38.175195] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=19] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:38.179372] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.183708] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FDE-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:38.185335] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4728-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:38.185810] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4728-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:38.186660] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FDF-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:38.187152] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1719219518186422000, start_id=1719219518186422000, end_id=1719219518186422001) [2024-06-24 16:58:38.191987] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FE2-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:38.194838] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FE3-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:38.195950] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4739-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:38.196412] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4739-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:38.197701] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FE4-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:38.201488] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=29] gc stale ls task succ [2024-06-24 16:58:38.205088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4746-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:38.205342] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4746-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:38.205841] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4746-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:38.206265] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4746-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:38.206533] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4746-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:38.208753] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219518208603000, start_id=1719219518208603000, end_id=1719219518208603001) [2024-06-24 16:58:38.221324] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FED-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:38.224509] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4765-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:38.228892] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C8FEF-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:38.231780] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:38.231891] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:38.232097] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:38.232160] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:38.232328] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:38.232402] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:38.232506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97338-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:38.239166] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:38.239189] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:38.239589] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3971) [2024-06-24 16:58:38.239654] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3971) [2024-06-24 16:58:38.239695] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:38.239716] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=435, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:38.239730] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:38.244762] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97339-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:38.254940] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.257809] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=6] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:38.257825] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:38.257834] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=8] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:38.257845] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=9] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:38.262003] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219518261475000, start_id=1719219518261475000, end_id=1719219518261475001) [2024-06-24 16:58:38.262418] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=5] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:92233720368547 [2024-06-24 16:58:38.263433] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1013] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:38.273726] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:38.273750] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] try gc retain ctx [2024-06-24 16:58:38.273780] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] get_max_applied_scn(scn={val:1719219517843757003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32432315}, palf_committed_end_scn_:{val:1719219517843757003, v:0}, last_check_scn_:{val:1719219517843757003, v:0}, max_applied_cb_scn_:{val:1719219517843757003, v:0}}) [2024-06-24 16:58:38.273815] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:38.276219] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A6-0-0] [lt=50][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:38.276248] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A6-0-0] [lt=28][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:38.276344] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=102] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219515562668000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219526480480000, latest_log_ts:{val:1719219509829313001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:38.276478] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=104] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:38.276503] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:38.276824] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1211) [2024-06-24 16:58:38.276860] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=15, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=426, avg_log_submit_to_slide_time=438) [2024-06-24 16:58:38.278723] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:38.278740] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C726-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:38.278759] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C726-0-0] [lt=16] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:38.278754] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=31] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:38.279026] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219515562668000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:38.279136] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=91] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=4680, avg_group_log_size=334) [2024-06-24 16:58:38.279158] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4689) [2024-06-24 16:58:38.279431] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.323109] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219518322816000, start_id=1719219518322816000, end_id=1719219518322816001) [2024-06-24 16:58:38.323195] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3970, avg_group_log_size=397) [2024-06-24 16:58:38.323220] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3971) [2024-06-24 16:58:38.323317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283381428224, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:38.325882] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111808, mem_used=262047744) [2024-06-24 16:58:38.342705] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:38.344654] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219518343936000, start_id=1719219518343936000, end_id=1719219518343936001) [2024-06-24 16:58:38.344699] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=390, get_gts_with_stc_cnt=32, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=30, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:38.344725] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:38.345163] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219518345145], gts:1719219518344992000, latest_srr:[mts=1719219518345145]}) [2024-06-24 16:58:38.349299] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219518349217000, start_id=1719219518349217000, end_id=1719219518349217001) [2024-06-24 16:58:38.352727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:38.354999] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.359545] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97348-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:38.362665] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97349-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:38.365927] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:38.365964] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:38.379489] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.382542] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4859-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:38.382786] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4859-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:38.385913] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10740DA-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:38.386824] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219518386130000, start_id=1719219518386130000, end_id=1719219518386130001) [2024-06-24 16:58:38.389639] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=17] LogLoopThread round_cost_time(us)(round_cost_time=35) [2024-06-24 16:58:38.405770] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9735D-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:38.409430] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219518409326000, start_id=1719219518409326000, end_id=1719219518409326001) [2024-06-24 16:58:38.409508] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:38.409544] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:38.409917] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=350, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:38.409951] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:38.409980] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:38.410003] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=408, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:38.410020] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=23, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:38.410087] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1719219518208603000, v:0}, new_max_version={val:1719219518208603000, v:0}, last_min_version={val:1719219518008510000, v:0}, last_max_version={val:1719219518008510000, v:0}, total_time_us=2616, delta_us=201482) [2024-06-24 16:58:38.410117] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1719219518208603000, v:0}, min_version={val:1719219518208603000, v:0}, max_version={val:1719219518208603000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:38.410145] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:38.420327] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129703, mem_used=326519808) [2024-06-24 16:58:38.426613] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:38.426843] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:38.426932] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:38.427019] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:38.427157] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:38.427381] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:38.427475] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:38.427555] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:38.427773] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:38.427858] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:38.427986] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:38.428058] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:38.428234] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:38.428310] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:38.428379] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:38.428484] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:38.428650] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:38.428724] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:38.428793] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:38.428867] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:38.428993] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:38.429066] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:38.429205] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:38.429280] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A48A5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:38.441559] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:38.443688] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=25] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:38.443735] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=46] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:38.443781] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=37] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:38.443932] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219515840319000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:38.444048] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=111] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:38.444102] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=46] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:38.444125] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219517342441001, v:0}) [2024-06-24 16:58:38.444139] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:38.444168] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:38.444198] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:38.444221] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:38.446335] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:38.446363] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=28] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:38.446398] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=31] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:38.446633] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=20] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219515840319000, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:38.446737] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=98] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:38.446757] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:38.446778] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:38.446802] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:38.446822] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:38.446836] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:38.452804] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=6] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:38.452833] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=24] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:38.452850] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:38.452864] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=12] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:38.455057] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.458136] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=10] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:38.458378] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=239] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:38.460711] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:38.462096] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219518462054000, start_id=1719219518462054000, end_id=1719219518462054001) [2024-06-24 16:58:38.468805] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=16] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:38.468830] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=23] try gc retain ctx [2024-06-24 16:58:38.468859] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=10] get_max_applied_scn(scn={val:1719219518409326000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70297156}, palf_committed_end_scn_:{val:1719219518462054000, v:0}, last_check_scn_:{val:1719219518462054000, v:0}, max_applied_cb_scn_:{val:1719219518409326000, v:0}}) [2024-06-24 16:58:38.468893] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:38.471254] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=102] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:38.479549] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.480773] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=77] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:38.509012] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=46] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:38.516990] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=41] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:38.523416] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219518523313000, start_id=1719219518523313000, end_id=1719219518523313001) [2024-06-24 16:58:38.523843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283377233920, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:38.523909] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=375, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:38.523940] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:38.529032] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:38.530856] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:38.530959] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516701057000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:38.537653] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC0C-0-0] [lt=12][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103414629017, cache_obj->added_lc()=false, cache_obj->get_object_id()=9360, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:38.540262] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=22] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:38.550212] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219518549707000, start_id=1719219518549707000, end_id=1719219518549707001) [2024-06-24 16:58:38.550921] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97398-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:38.552815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:38.554101] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97399-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:38.555114] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.559946] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9739B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:38.562293] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A49F9-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:38.565316] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9739C-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:38.566396] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:38.566447] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=391, avg_log_submit_to_slide_time=401) [2024-06-24 16:58:38.568905] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8376, avg_group_log_size=492) [2024-06-24 16:58:38.568937] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8376) [2024-06-24 16:58:38.569254] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8376) [2024-06-24 16:58:38.573508] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1719219518573505, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-06-24 16:58:38.574248] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=2209) [2024-06-24 16:58:38.574282] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=2209) [2024-06-24 16:58:38.574319] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=371, avg_log_submit_to_slide_time=382) [2024-06-24 16:58:38.579609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.580676] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=19] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13734, offset=3449440}, end_cursor:ObLogCursor{file_id=1, log_id=13735, offset=3449713}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c7c050, len:3488, log_data_len:273, seq:13734, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:38.582901] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D90D-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219518582465000, start_id=1719219518582465000, end_id=1719219518582465001) [2024-06-24 16:58:38.583329] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8375) [2024-06-24 16:58:38.583368] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=385, avg_log_submit_to_slide_time=395) [2024-06-24 16:58:38.583425] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=10] [APPLY STAT CB APPEND COST TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=31, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:38.583456] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=390, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:38.583477] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:38.583491] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=-547, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:38.583503] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=-125, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:38.583906] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13735, offset=3449713}, end_cursor:ObLogCursor{file_id=1, log_id=13736, offset=3449978}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c80050, len:3215, log_data_len:265, seq:13735, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:38.587502] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219518586694000, start_id=1719219518586694000, end_id=1719219518586694001) [2024-06-24 16:58:38.589766] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1809] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:66, min_worker_cnt:42, max_worker_cnt:150, stopped:0, worker_us:367530352, recv_hp_rpc_cnt:3233, recv_np_rpc_cnt:3444, recv_lp_rpc_cnt:0, recv_mysql_cnt:32226, recv_task_cnt:51, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:24937214, workers:42, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=128 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:25046, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213256365800}{group_id:10, queue_size:0, recv_req_cnt:6255, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213261360250}{group_id:20, queue_size:0, recv_req_cnt:965, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918743789}{group_id:15, queue_size:0, recv_req_cnt:13, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216919852802}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213258715738}{group_id:9, queue_size:0, recv_req_cnt:160, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213252335182}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=2, token_change_ts:1719213259025542, tenant_role:1}) [2024-06-24 16:58:38.591103] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A4-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:38.590720] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=952] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245340110, is_removed:false}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:80036144, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:1381, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:31144885, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1719213259035589, tenant_role:0}) [2024-06-24 16:58:38.591464] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=743] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245333314, is_removed:false}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:44244034, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:15571287, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1719213259048104, tenant_role:0}) [2024-06-24 16:58:38.592245] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=780] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:24049803, recv_hp_rpc_cnt:74, recv_np_rpc_cnt:6094, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2471966, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24770, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213325131824}{group_id:20, queue_size:0, recv_req_cnt:641, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215168816313}{group_id:5, queue_size:0, recv_req_cnt:22, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213327935283}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1719213324836532, tenant_role:1}) [2024-06-24 16:58:38.594252] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A5-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:38.594154] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1908] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:150, stopped:0, worker_us:6426050380, recv_hp_rpc_cnt:2104, recv_np_rpc_cnt:7, recv_lp_rpc_cnt:0, recv_mysql_cnt:17570854, recv_task_cnt:354, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:43532848, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49418, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213333985763}{group_id:20, queue_size:0, recv_req_cnt:1946, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215769388477}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918841349}, rpc_stat_info: pcode=0x150a:cnt=41 pcode=0x150b:cnt=41, token_change_ts:1719213324547495, tenant_role:1}) [2024-06-24 16:58:38.596127] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1972] dump tenant info(tenant={id:1003, tenant_meta:{unit:{tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1003, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:26672984, recv_hp_rpc_cnt:57, recv_np_rpc_cnt:6070, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2461880, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24664, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213351914771}{group_id:20, queue_size:0, recv_req_cnt:564, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216369834163}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213354638840}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1719213351641415, tenant_role:1}) [2024-06-24 16:58:38.599092] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A7-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:38.598078] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1950] dump tenant info(tenant={id:1004, tenant_meta:{unit:{tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1004, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:184, stopped:0, worker_us:184361450, recv_hp_rpc_cnt:5103, recv_np_rpc_cnt:1393, recv_lp_rpc_cnt:0, recv_mysql_cnt:40505, recv_task_cnt:15, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:9881217, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49202, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213361134602}{group_id:20, queue_size:0, recv_req_cnt:3494, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216969504568}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918851855}, rpc_stat_info: pcode=0x150a:cnt=41 pcode=0x150b:cnt=41, token_change_ts:1719217153282307, tenant_role:1}) [2024-06-24 16:58:38.601827] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90D4-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219518601495000, start_id=1719219518601495000, end_id=1719219518601495001) [2024-06-24 16:58:38.602422] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:38.602529] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:38.602732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:38.602795] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:38.602950] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:38.603033] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:38.603137] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973A9-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:38.604691] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2024-06-24 16:58:38.604753] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:666) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=4) [2024-06-24 16:58:38.604781] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:666) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] TxData Memory Statistic(logstream info): (ls_id={id:1001}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=8) [2024-06-24 16:58:38.604797] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:572) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=14] TxData Memory Statistic : (Tenant Total Memory(MB)=7168, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=12, Freeze TxData Trigger Memory(MB)=143, Total TxDataTable Hold Memory(MB)=18, Total TxDataTable Memory Limit(MB)=1433) [2024-06-24 16:58:38.609542] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219518608897000, start_id=1719219518608897000, end_id=1719219518608897001) [2024-06-24 16:58:38.618584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973AA-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:38.620460] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:38.620961] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:38.639869] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=425, avg_log_submit_to_slide_time=438) [2024-06-24 16:58:38.655056] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973B5-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:38.655173] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.657161] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A4B00-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:38.662210] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219518661700000, start_id=1719219518661700000, end_id=1719219518661700001) [2024-06-24 16:58:38.666490] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=361, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:38.666524] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:38.666538] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:38.666560] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=432, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:38.666574] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=21, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:38.676397] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD52-0-0] [lt=28] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:38.679666] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.699948] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:38.707869] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB973C8-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:38.720896] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [162333][Blacklist][T0][Y0-0000000000000000-0-0] [lt=33] blacklist_loop exec finished(cost_time=46, is_enabled=true, send_cnt=0) [2024-06-24 16:58:38.723568] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219518722974000, start_id=1719219518722974000, end_id=1719219518722974001) [2024-06-24 16:58:38.723781] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=45765, mem_used=164299776) [2024-06-24 16:58:38.724334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283373039616, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:38.730181] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:38.738286] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90F4-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:38.744601] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90FD-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:38.744851] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90FD-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:38.745294] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90FD-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:38.745686] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90FD-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:38.745930] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C90FD-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:38.750335] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219518749398000, start_id=1719219518749398000, end_id=1719219518749398001) [2024-06-24 16:58:38.750410] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:38.750444] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:38.750820] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=390, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:38.750855] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:38.750883] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:38.750900] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=472, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:38.750916] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=27, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:38.752899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:38.755229] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.766567] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=120] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:38.766579] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:38.766630] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=19] [APPLY STAT CB APPEND COST TIME](cur_stat_count=12, stat_interval=5000000, avg (count/cost)=26, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:38.766660] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=29] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=12, stat_interval=5000000, avg (count/cost)=384, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:38.766677] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=12, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:38.766698] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=20] [APPLY STAT CB EXECUTE TIME](cur_stat_count=12, stat_interval=5000000, avg (count/cost)=-552, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:38.766711] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=12, stat_interval=5000000, avg (count/cost)=-141, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:38.779727] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.787573] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219518787413000, start_id=1719219518787413000, end_id=1719219518787413001) [2024-06-24 16:58:38.787534] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221494467, support_ssl=false) [2024-06-24 16:58:38.787723] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=146] sm conn init succ(conn.sessid_=3221494467, sess.client_addr_="172.20.17.86:49510") [2024-06-24 16:58:38.787748] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f47833c2030, session_id:3221494467, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:38.787809] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494467, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:38.787843] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221494467, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:38.787859] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494467, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:38.787882] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494467) [2024-06-24 16:58:38.787896] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162503][sql_nio13][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494467, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:38.789921] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:91170, max_lsn:70300567, max_scn:{val:1719219518661700001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:70300567}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:28357527}}, last_submit_lsn:{lsn:70300445}, last_submit_end_lsn:{lsn:70300567}, last_submit_log_id:91170, last_submit_log_pid:1, max_flushed_lsn:{lsn:70300445}, max_flushed_end_lsn:{lsn:70300567}, max_flushed_log_pid:1, committed_end_lsn:{lsn:70300567}, last_slide_log_id:91170, last_slide_scn:{val:1719219518661700001, v:0}, last_slide_lsn:{lsn:70300445}, last_slide_end_lsn:{lsn:70300567}, last_slide_log_pid:1, last_slide_log_accum_checksum:149203062, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4755346530}, [StateMgr]={this:0x7f475534a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:91171, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213327209529, palf_role_change_cb:0x7f4755350cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4755347c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/meta", dir_fd:666, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f475534c478, flashback_version:0}, log_storage:{log_tail:{lsn:70300567}, readable_log_tail:{lsn:70300567}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719219133216967001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/log", dir_fd:667, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:63908969, block_header_serialize_buf_:0x7f475534e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213327209030, this:0x7f475534a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213327209993, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f475534a430}) [2024-06-24 16:58:38.790286] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=359] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219518769419, last_flushed_end_lsn:{lsn:70300567}}]) [2024-06-24 16:58:38.790315] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=25] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=91171, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219518769419, last_flushed_end_lsn:{lsn:70300567}}]) [2024-06-24 16:58:38.803181] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107427D-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:38.809795] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219518809616000, start_id=1719219518809616000, end_id=1719219518809616001) [2024-06-24 16:58:38.811538] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=9] ====== check clog disk timer task ====== [2024-06-24 16:58:38.811560] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=14] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=114) [2024-06-24 16:58:38.811585] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=14] cannot_recycle_log_size statistics(cannot_recycle_log_size=53469809, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:38.825397] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=10] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=29, mem_used=49913856) [2024-06-24 16:58:38.825421] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] release old cannot free more memory [2024-06-24 16:58:38.825429] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=7] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=32, size_used=0, mem_used=49913856) [2024-06-24 16:58:38.837709] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C91FF-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:38.837941] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C91FF-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:38.841058] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9202-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:38.845540] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219518845496000, start_id=1719219518845496000, end_id=1719219518845496001) [2024-06-24 16:58:38.845569] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] ts response task statistics(alloc_count=248318, free_count=124158) [2024-06-24 16:58:38.845598] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219518845533], gts:1719219518845496000, latest_srr:[mts=1719219518845533]}) [2024-06-24 16:58:38.845645] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219518845620], gts:1719219518845496000, latest_srr:[mts=1719219518845620]}) [2024-06-24 16:58:38.845680] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219518845666], gts:1719219518845496000, latest_srr:[mts=1719219518845666]}) [2024-06-24 16:58:38.845706] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219518845696], gts:1719219518845496000, latest_srr:[mts=1719219518845696]}) [2024-06-24 16:58:38.855287] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.862357] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219518861355000, start_id=1719219518861355000, end_id=1719219518861355001) [2024-06-24 16:58:38.866676] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:38.866709] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=417, avg_log_submit_to_slide_time=425) [2024-06-24 16:58:38.868780] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=871, pos=839, bitmap=NULL) [2024-06-24 16:58:38.868913] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=380, pos=136, bitmap=NULL) [2024-06-24 16:58:38.869054] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=644, pos=140, bitmap=NULL) [2024-06-24 16:58:38.869219] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=61, pos=7, bitmap=NULL) [2024-06-24 16:58:38.869439] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:38.869541] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=1064, pos=934, bitmap=NULL) [2024-06-24 16:58:38.869741] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=158, pos=114, bitmap=NULL) [2024-06-24 16:58:38.869923] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=158, pos=144, bitmap=NULL) [2024-06-24 16:58:38.870062] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=605, pos=576, bitmap=NULL) [2024-06-24 16:58:38.870083] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97409-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:38.870194] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=1043, pos=1021, bitmap=NULL) [2024-06-24 16:58:38.870366] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=318, pos=119, bitmap=NULL) [2024-06-24 16:58:38.870458] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=400, pos=134, bitmap=NULL) [2024-06-24 16:58:38.870598] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=785, pos=127, bitmap=NULL) [2024-06-24 16:58:38.870696] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=802, pos=127, bitmap=NULL) [2024-06-24 16:58:38.870802] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=911, pos=126, bitmap=NULL) [2024-06-24 16:58:38.870951] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=945, pos=934, bitmap=NULL) [2024-06-24 16:58:38.871085] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=880, pos=125, bitmap=NULL) [2024-06-24 16:58:38.871168] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=1001, pos=971, bitmap=NULL) [2024-06-24 16:58:38.871287] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=795, pos=135, bitmap=NULL) [2024-06-24 16:58:38.871368] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=908, pos=141, bitmap=NULL) [2024-06-24 16:58:38.871517] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=209, pos=148, bitmap=NULL) [2024-06-24 16:58:38.871607] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10742AF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=1377, pos=160, bitmap=NULL) [2024-06-24 16:58:38.873409] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9740A-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:38.873597] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.873658] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.873656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.873982] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874102] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874211] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874451] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874483] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874496] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874703] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874703] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874705] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874706] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874709] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874719] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.874721] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:38.879710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9740C-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:38.879785] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.880761] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920C-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:38.881083] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:38.881332] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920C-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:38.881585] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920C-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:38.882032] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920C-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:38.882946] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9740D-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:38.886261] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9740E-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:38.905448] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=792, pos=506, bitmap=NULL) [2024-06-24 16:58:38.905877] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=23, len=790, pos=652, bitmap=NULL) [2024-06-24 16:58:38.906209] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=526, pos=497, bitmap=NULL) [2024-06-24 16:58:38.906360] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=362, pos=348, bitmap=NULL) [2024-06-24 16:58:38.906711] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=876, pos=691, bitmap=NULL) [2024-06-24 16:58:38.907065] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=19, len=536, pos=507, bitmap=NULL) [2024-06-24 16:58:38.907219] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=395, pos=393, bitmap=NULL) [2024-06-24 16:58:38.907473] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C920F-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=15, len=391, pos=324, bitmap=NULL) [2024-06-24 16:58:38.911506] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:38.912809] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97417-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:38.915858] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97418-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:38.918174] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=62] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:38.918812] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=26] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16487, offset=3756185}, end_cursor:ObLogCursor{file_id=1, log_id=16488, offset=3756458}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c84050, len:3943, log_data_len:273, seq:16487, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:38.920536] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741A-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:38.920896] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FE-0-0] [lt=30] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334374136924743652e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.949462451897566950e+01) [2024-06-24 16:58:38.922524] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9215-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:38.922772] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9215-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:38.922809] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FE-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1719219518922447000, start_id=1719219518922447000, end_id=1719219518922447001) [2024-06-24 16:58:38.922915] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FE-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8886, avg_group_log_size=683) [2024-06-24 16:58:38.922944] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FE-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7889) [2024-06-24 16:58:38.923330] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8886) [2024-06-24 16:58:38.923338] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:38.923383] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8886) [2024-06-24 16:58:38.923422] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=22, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=437, avg_log_submit_to_slide_time=448) [2024-06-24 16:58:38.923446] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:38.923639] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219518923504000, start_id=1719219518923504000, end_id=1719219518923504001) [2024-06-24 16:58:38.923662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:38.923733] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:38.923929] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:38.924006] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:38.924009] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=33] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16488, offset=3756458}, end_cursor:ObLogCursor{file_id=1, log_id=16489, offset=3756723}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c88050, len:3670, log_data_len:265, seq:16488, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:38.924109] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:38.924838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283375136768, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:38.928529] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9218-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:38.936949] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9741D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:38.943850] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1719219518943848, bytes: 170753634, bw: 0.019928 MB/s, add_ts: 1007617, add_bytes: 21055 [2024-06-24 16:58:38.948530] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=17314036, clean_num=201326) [2024-06-24 16:58:38.949730] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9220-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:38.950654] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219518949858000, start_id=1719219518949858000, end_id=1719219518949858001) [2024-06-24 16:58:38.952983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:38.955347] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.955786] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2024-06-24 16:58:38.966333] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:38.966387] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:38.966426] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:38.966456] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:38.966505] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:38.967055] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=352, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:38.967811] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=42] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:38.974504] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1211) [2024-06-24 16:58:38.978170] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9742C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:38.979845] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:38.981195] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9742D-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:38.987714] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219518986867000, start_id=1719219518986867000, end_id=1719219518986867001) [2024-06-24 16:58:39.002828] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=30] gc stale ls task succ [2024-06-24 16:58:39.005001] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=33] log compressor cycles once. (ret=0, cost_time=1058, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261360152576) [2024-06-24 16:58:39.009955] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219519009072000, start_id=1719219519009072000, end_id=1719219519009072001) [2024-06-24 16:58:39.032416] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97440-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:39.035604] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:39.035641] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=29] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:39.035676] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=348780656, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:39.039419] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 363.50) [2024-06-24 16:58:39.039448] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:39.039550] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 399.50) [2024-06-24 16:58:39.039566] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:39.039599] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039619] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039673] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039687] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039701] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039720] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039731] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039745] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039759] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039774] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039788] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039802] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039816] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039830] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039846] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.039860] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:39.054579] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:39.055404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.062456] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219519061869000, start_id=1719219519061869000, end_id=1719219519061869001) [2024-06-24 16:58:39.074224] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:39.074263] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:39.074297] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:39.074318] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:39.074567] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=363, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:39.074586] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:39.074616] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:39.074649] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C90F1-0-0] [lt=8] [APPLY STAT CB APPEND COST TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=31, this=0x7f4753d24280, extra_info="") [2024-06-24 16:58:39.074660] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=422, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:39.074672] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C90F1-0-0] [lt=21] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=1272, this=0x7f4753d244b0, extra_info="") [2024-06-24 16:58:39.074675] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:39.074688] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C90F1-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=0, this=0x7f4753d246e0, extra_info="") [2024-06-24 16:58:39.074703] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C90F1-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=-557, this=0x7f4753d24910, extra_info="") [2024-06-24 16:58:39.074717] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA08C90F1-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=746, this=0x7f4753d24b40, extra_info="") [2024-06-24 16:58:39.074858] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=376, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:39.074893] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:39.074910] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:39.074925] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=438, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:39.074939] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=22, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:39.079856] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.095822] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=681, mem_used=2079744) [2024-06-24 16:58:39.096198] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.096652] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.096655] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.096663] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097183] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097185] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=7] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097187] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097211] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097233] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097246] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097245] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097255] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097393] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097444] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097632] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097633] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097682] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097679] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097693] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097710] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097705] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097705] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097728] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097772] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097812] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097897] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097939] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097943] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.097949] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098161] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098248] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098256] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098330] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098344] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098588] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098667] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098619] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098659] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098693] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098698] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098707] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.098999] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.123799] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519123176000, start_id=1719219519123176000, end_id=1719219519123176001) [2024-06-24 16:58:39.133886] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:39.149027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283373039616, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:39.150592] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219519149603000, start_id=1719219519149603000, end_id=1719219519149603001) [2024-06-24 16:58:39.150596] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DB-0-0] [lt=37] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:39.150638] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DB-0-0] [lt=39] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:39.152386] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F6-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:39.152422] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F6-0-0] [lt=33] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:39.153066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:39.155461] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.166518] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:39.166901] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:39.166922] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:39.166943] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=411, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:39.166959] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=23, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:39.175285] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=20] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:39.179914] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.181064] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D42A-0-0] [lt=18] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.185788] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9747B-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:39.187829] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219519187654000, start_id=1719219519187654000, end_id=1719219519187654001) [2024-06-24 16:58:39.188554] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9747C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:39.193701] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9747E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:39.196397] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9747F-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:39.199129] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97480-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:39.201549] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:39.209997] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219519209867000, start_id=1719219519209867000, end_id=1719219519209867001) [2024-06-24 16:58:39.218588] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:39.220350] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:39.220451] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516793682000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:39.221957] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97489-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:39.221966] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=34] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:39.224762] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9748A-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:39.225675] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D478-0-0] [lt=64] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.229083] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9748C-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:39.231453] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:39.231506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:39.231583] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:39.231615] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:39.231694] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:39.231723] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=6][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:39.231759] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A50D8-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:39.233541] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:39.233582] INFO [COMMON] handle (memory_dump.cpp:552) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:39.233897] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] update_check_range(min_check_version=622, max_check_version=622, global_version=624) [2024-06-24 16:58:39.239664] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:39.239687] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:39.240041] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3412) [2024-06-24 16:58:39.240085] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3412) [2024-06-24 16:58:39.240125] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:39.240146] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=468, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:39.240163] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=32, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:39.242019] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9748F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:39.255518] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.262556] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219519261657000, start_id=1719219519261657000, end_id=1719219519261657001) [2024-06-24 16:58:39.279520] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9749E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:39.279971] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.282297] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9749F-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:39.287304] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A7-0-0] [lt=52][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:39.287337] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A7-0-0] [lt=32][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:39.300911] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:39.300935] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:39.300967] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=20] cannot_recycle_log_size statistics(cannot_recycle_log_size=70304349, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:39.319296] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=59] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:39.323686] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219519322976000, start_id=1719219519322976000, end_id=1719219519322976001) [2024-06-24 16:58:39.323769] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3413, avg_group_log_size=379) [2024-06-24 16:58:39.323795] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3412) [2024-06-24 16:58:39.325664] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:39.325996] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=111828, mem_used=262047744) [2024-06-24 16:58:39.329615] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974B2-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:39.332124] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C922F-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219519331439000, start_id=1719219519331439000, end_id=1719219519331439001) [2024-06-24 16:58:39.332182] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C922F-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=2850, avg_group_log_size=237) [2024-06-24 16:58:39.332198] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C922F-0-0] [lt=13] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2331) [2024-06-24 16:58:39.332337] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A51FF-0-0] [lt=7] get number(ret=0, service_type_=0, range=1, base_id=1719219519331439000, start_id=1719219519331439001, end_id=1719219519331439002) [2024-06-24 16:58:39.342832] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:39.346439] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219519346244000, start_id=1719219519346244000, end_id=1719219519346244001) [2024-06-24 16:58:39.346478] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:39.349541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283370942464, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:39.350682] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1719219519350472000, start_id=1719219519350472000, end_id=1719219519350472001) [2024-06-24 16:58:39.353147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:39.355579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.366603] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=36] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:39.366658] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:39.374406] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1342, avg_group_log_size=122) [2024-06-24 16:58:39.374438] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1333) [2024-06-24 16:58:39.374734] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1342) [2024-06-24 16:58:39.374773] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=388, avg_log_submit_to_slide_time=399) [2024-06-24 16:58:39.380029] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.387975] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519387433000, start_id=1719219519387433000, end_id=1719219519387433001) [2024-06-24 16:58:39.402950] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D43E-0-0] [lt=29] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.403163] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D440-0-0] [lt=31] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.403370] INFO handle (memory_dump.cpp:679) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] statistics: tenant_cnt: 8, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 269 257 0 1 2 65 1 0 1 4 1 1 0 1 5 67 4 0 1 7 1 2 0 1 8 72 1 0 1 12 7 3 0 1 13 7 1 0 1 14 1 2 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 1 22 1 1 0 500 0 105 232 0 500 7 4 4 0 500 8 85 1 0 500 9 5 1 0 500 10 6 2 0 500 16 3 1 0 500 17 37 7 0 500 22 90 62 0 500 23 69 11 0 508 0 5 11 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 90 221 0 1001 2 22 1 0 1001 4 1 1 0 1001 5 19 4 0 1001 8 45 1 0 1001 12 4 3 0 1001 13 2 1 0 1001 14 1 2 0 1001 18 7 3 0 1001 20 1 1 0 1002 0 225 248 0 1002 2 201 1 0 1002 4 1 1 0 1002 5 109 4 0 1002 6 1 2 0 1002 8 59 1 0 1002 12 14 3 0 1002 13 9 1 0 1002 14 1 2 0 1002 18 7 3 0 1002 20 1 1 0 1003 0 125 225 0 1003 2 22 1 0 1003 4 1 1 0 1003 5 30 4 0 1003 8 47 1 0 1003 12 5 3 0 1003 13 2 1 0 1003 14 1 2 0 1003 18 6 3 0 1003 20 1 1 0 1004 0 320 249 0 1004 2 95 1 0 1004 4 1 1 0 1004 5 71 4 0 1004 8 60 1 0 1004 12 17 3 0 1004 13 10 1 0 1004 14 1 2 0 1004 18 6 3 0 1004 20 1 1 0 cost_time: 169540 [2024-06-24 16:58:39.403415] INFO [LIB] operator() (ob_malloc_allocator.cpp:542) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 18,253,611,008 hold: 1,574,858,752 rpc_hold: 0 cache_hold: 232,783,872 cache_used: 232,783,872 cache_item_count: 111 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 832,446,464 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 136,314,880 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 140,509,184 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 150,994,944 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 14,680,064 limit= 3,650,722,200 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 6,311,936 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2024-06-24 16:58:39.403826] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 832,446,464 used= 727,214,896 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 342,212,608 used= 342,058,688 count= 128 avg_used= 2,672,333 block_cnt= 128 chunk_cnt= 128 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 38,563,840 used= 38,535,392 count= 2 avg_used= 19,267,696 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 37,769,216 used= 37,748,856 count= 1 avg_used= 37,748,856 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 24,727,552 used= 24,661,440 count= 39 avg_used= 632,344 block_cnt= 39 chunk_cnt= 22 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 18,800,640 used= 17,629,680 count= 255 avg_used= 69,136 block_cnt= 255 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 16,797,696 used= 16,777,336 count= 1 avg_used= 16,777,336 block_cnt= 1 chunk_cnt= 1 mod=MrgMemPoolChk [MEMORY] hold= 15,014,736 used= 14,885,937 count= 98 avg_used= 151,897 block_cnt= 37 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 12,492,800 used= 12,451,840 count= 2 avg_used= 6,225,920 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,257,536 used= 8,240,064 count= 2 avg_used= 4,120,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 6,862,480 used= 6,837,464 count= 70 avg_used= 97,678 block_cnt= 70 chunk_cnt= 12 mod=TabletMap [MEMORY] hold= 6,381,568 used= 5,627,904 count= 92 avg_used= 61,172 block_cnt= 92 chunk_cnt= 23 mod=[T]char [MEMORY] hold= 6,148,096 used= 6,131,072 count= 1 avg_used= 6,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,601,152 used= 4,530,096 count= 978 avg_used= 4,632 block_cnt= 978 chunk_cnt= 33 mod=WorkerMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 6 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,883,008 used= 3,841,152 count= 6 avg_used= 640,192 block_cnt= 6 chunk_cnt= 2 mod=TransTimeWheel [MEMORY] hold= 3,883,008 used= 3,841,152 count= 6 avg_used= 640,192 block_cnt= 6 chunk_cnt= 3 mod=XATimeWheel [MEMORY] hold= 3,842,048 used= 3,820,032 count= 2 avg_used= 1,910,016 block_cnt= 2 chunk_cnt= 2 mod=LDBlockBitMap [MEMORY] hold= 3,763,584 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 13 mod=CkptDgnMemCU [MEMORY] hold= 3,763,584 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 14 mod=CkptDgnMem [MEMORY] hold= 3,723,264 used= 3,698,688 count= 2 avg_used= 1,849,344 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 6 mod=SqlDtlQueue [MEMORY] hold= 2,711,552 used= 2,693,824 count= 1 avg_used= 2,693,824 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,864 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,097,152 used= 2,093,056 count= 32 avg_used= 65,408 block_cnt= 32 chunk_cnt= 12 mod=StorMetaCacheIO [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 2 mod=DagMap [MEMORY] hold= 1,777,664 used= 1,770,696 count= 1 avg_used= 1,770,696 block_cnt= 1 chunk_cnt= 1 mod=TableProc [MEMORY] hold= 1,681,536 used= 1,666,560 count= 205 avg_used= 8,129 block_cnt= 205 chunk_cnt= 23 mod=ParamCharsType [MEMORY] hold= 1,584,288 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,269,184 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 2 mod=PoolFreeList [MEMORY] hold= 1,253,376 used= 1,114,112 count= 17 avg_used= 65,536 block_cnt= 17 chunk_cnt= 8 mod=MinorMergeMgr [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 950,272 used= 508,544 count= 58 avg_used= 8,768 block_cnt= 58 chunk_cnt= 20 mod=[T]ObDSActionAr [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 920,000 used= 912,640 count= 115 avg_used= 7,936 block_cnt= 115 chunk_cnt= 22 mod=QueryAllocator [MEMORY] hold= 829,632 used= 804,864 count= 258 avg_used= 3,119 block_cnt= 130 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 819,200 used= 804,640 count= 5 avg_used= 160,928 block_cnt= 5 chunk_cnt= 5 mod=SQLSessionInfo [MEMORY] hold= 802,944 used= 786,432 count= 256 avg_used= 3,072 block_cnt= 128 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 794,624 used= 786,440 count= 1 avg_used= 786,440 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 794,624 used= 786,440 count= 1 avg_used= 786,440 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 786,560 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 2 mod=LogAlloc [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 576,128 used= 571,392 count= 72 avg_used= 7,936 block_cnt= 72 chunk_cnt= 22 mod=GlobalIter [MEMORY] hold= 566,784 used= 558,912 count= 123 avg_used= 4,544 block_cnt= 123 chunk_cnt= 22 mod=[T]ObTraceEvent [MEMORY] hold= 462,384 used= 458,736 count= 57 avg_used= 8,048 block_cnt= 57 chunk_cnt= 20 mod=[T]ObPerfEventR [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 393,216 used= 376,752 count= 6 avg_used= 62,792 block_cnt= 6 chunk_cnt= 6 mod=CommSysVarFac [MEMORY] hold= 385,024 used= 377,120 count= 1 avg_used= 377,120 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 2 mod=bf_queue [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 272,000 used= 269,824 count= 34 avg_used= 7,936 block_cnt= 34 chunk_cnt= 7 mod=LinearHashMapNo [MEMORY] hold= 262,144 used= 261,632 count= 4 avg_used= 65,408 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 240,000 used= 238,080 count= 30 avg_used= 7,936 block_cnt= 30 chunk_cnt= 5 mod=LockWaitMgr [MEMORY] hold= 212,992 used= 212,160 count= 1 avg_used= 212,160 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 200,704 used= 196,608 count= 64 avg_used= 3,072 block_cnt= 32 chunk_cnt= 4 mod=TxCtxMgr [MEMORY] hold= 181,440 used= 178,560 count= 45 avg_used= 3,968 block_cnt= 23 chunk_cnt= 6 mod=TinyAllocator [MEMORY] hold= 168,128 used= 166,656 count= 21 avg_used= 7,936 block_cnt= 21 chunk_cnt= 13 mod=LSIter [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=MemtableSetBkt [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 106,496 used= 98,432 count= 1 avg_used= 98,432 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 98,304 used= 97,760 count= 1 avg_used= 97,760 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 7 mod=SqlSession [MEMORY] hold= 88,000 used= 87,296 count= 11 avg_used= 7,936 block_cnt= 11 chunk_cnt= 8 mod=PartCtx [MEMORY] hold= 81,920 used= 65,536 count= 2 avg_used= 32,768 block_cnt= 2 chunk_cnt= 1 mod=CsDictPl [MEMORY] hold= 78,720 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 7 mod=HashNodeLCSta [MEMORY] hold= 78,720 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 6 mod=TabletIDSetNode [MEMORY] hold= 74,960 used= 36,624 count= 523 avg_used= 70 block_cnt= 159 chunk_cnt= 32 mod=Coro [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoMgr [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 72,768 used= 71,424 count= 7 avg_used= 10,203 block_cnt= 7 chunk_cnt= 4 mod=NotParamInfo [MEMORY] hold= 72,240 used= 1,024 count= 896 avg_used= 1 block_cnt= 10 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 72,000 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 8 mod=SqlSessiVarMap [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 56,832 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 49,152 used= 49,088 count= 1 avg_used= 49,088 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 48,832 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 48,784 used= 44,792 count= 2 avg_used= 22,396 block_cnt= 2 chunk_cnt= 2 mod=Autoincrement [MEMORY] hold= 48,000 used= 47,616 count= 6 avg_used= 7,936 block_cnt= 6 chunk_cnt= 6 mod=PlanVaIdx [MEMORY] hold= 45,632 used= 41,664 count= 62 avg_used= 672 block_cnt= 29 chunk_cnt= 12 mod=[T]ObWarningBuf [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=ConstPl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=CsStrPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=RawPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=CsIntPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=DictPl [MEMORY] hold= 40,000 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 2 mod=ObDMMDL [MEMORY] hold= 40,000 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 4 mod=MdsTableMgr [MEMORY] hold= 39,360 used= 39,040 count= 5 avg_used= 7,808 block_cnt= 5 chunk_cnt= 4 mod=HashNodePlanCac [MEMORY] hold= 35,200 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 10 chunk_cnt= 6 mod=CACHE_INST [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 25,664 count= 1 avg_used= 25,664 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 32,768 used= 17,408 count= 2 avg_used= 8,704 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTTP [MEMORY] hold= 32,576 used= 25,103 count= 2 avg_used= 12,551 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 31,680 used= 27,456 count= 66 avg_used= 416 block_cnt= 32 chunk_cnt= 7 mod=OMT_Worker [MEMORY] hold= 31,424 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 25,264 used= 6,120 count= 255 avg_used= 24 block_cnt= 97 chunk_cnt= 20 mod=[T]MemoryContex [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=IntDiffPl [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=RlePl [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,240 used= 20,136 count= 2 avg_used= 10,068 block_cnt= 2 chunk_cnt= 2 mod=TabletStats [MEMORY] hold= 24,208 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 24,000 used= 23,808 count= 3 avg_used= 7,936 block_cnt= 3 chunk_cnt= 1 mod=TableScanIter [MEMORY] hold= 23,904 used= 23,712 count= 3 avg_used= 7,904 block_cnt= 3 chunk_cnt= 2 mod=SqlSessionSbloc [MEMORY] hold= 23,568 used= 23,376 count= 3 avg_used= 7,792 block_cnt= 3 chunk_cnt= 3 mod=CkptDgnMemNode [MEMORY] hold= 20,160 used= 19,840 count= 5 avg_used= 3,968 block_cnt= 4 chunk_cnt= 3 mod=CkpDgn [MEMORY] hold= 18,320 used= 16,896 count= 22 avg_used= 768 block_cnt= 22 chunk_cnt= 8 mod=TGTimer [MEMORY] hold= 16,768 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 3 chunk_cnt= 2 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ColSubStrPl [MEMORY] hold= 16,384 used= 13,824 count= 1 avg_used= 13,824 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ColEqualPl [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TblCtxIMgr [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=StrPrefixPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=HexStrPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=StrDiffPl [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 2 mod=TltMemtablMgr [MEMORY] hold= 15,712 used= 15,584 count= 2 avg_used= 7,792 block_cnt= 2 chunk_cnt= 1 mod=CkptDgnCUNode [MEMORY] hold= 11,728 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 1 mod=StopWordSet [MEMORY] hold= 10,240 used= 10,112 count= 2 avg_used= 5,056 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 9,216 used= 9,080 count= 2 avg_used= 4,540 block_cnt= 2 chunk_cnt= 2 mod=GCMemtableMap [MEMORY] hold= 9,120 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 1 mod=FTPluginMap [MEMORY] hold= 8,320 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,320 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 7,968 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,792 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,776 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,696 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 5,184 used= 5,120 count= 1 avg_used= 5,120 block_cnt= 1 chunk_cnt= 1 mod=CtxBlockPl [MEMORY] hold= 4,800 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,288 used= 3,899 count= 6 avg_used= 649 block_cnt= 5 chunk_cnt= 2 mod=SqlSessiQuerSql [MEMORY] hold= 4,160 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 4,160 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=CsCtxBlockPl [MEMORY] hold= 3,136 used= 3,072 count= 1 avg_used= 3,072 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 3,072 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 3,056 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=PackStateMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=SequenceMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=ContextsMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 4 mod=SequenceIdMap [MEMORY] hold= 2,944 used= 2,624 count= 5 avg_used= 524 block_cnt= 5 chunk_cnt= 3 mod=NotParamIdex [MEMORY] hold= 2,400 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,304 used= 1,792 count= 8 avg_used= 224 block_cnt= 6 chunk_cnt= 4 mod=LogIOTask [MEMORY] hold= 2,240 used= 1,920 count= 5 avg_used= 384 block_cnt= 5 chunk_cnt= 4 mod=TableLockNode [MEMORY] hold= 1,920 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 1,920 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,728 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 1,664 used= 1,600 count= 1 avg_used= 1,600 block_cnt= 1 chunk_cnt= 1 mod=LogPartFetCtxPo [MEMORY] hold= 1,616 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,616 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,600 used= 40 count= 20 avg_used= 2 block_cnt= 20 chunk_cnt= 13 mod=[T]TSIUseWeak [MEMORY] hold= 1,488 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,408 used= 1,280 count= 2 avg_used= 640 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,344 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,264 used= 864 count= 6 avg_used= 144 block_cnt= 6 chunk_cnt= 3 mod=ObTxLSLogCb [MEMORY] hold= 1,152 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,120 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,024 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 848 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=HashBucPsSessIn [MEMORY] hold= 848 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 720 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 624 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 544 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 480 used= 120 count= 5 avg_used= 24 block_cnt= 1 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 448 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 288 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 288 used= 216 count= 1 avg_used= 216 block_cnt= 1 chunk_cnt= 1 mod=memtable_set [MEMORY] hold= 288 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 272 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 224 used= 64 count= 2 avg_used= 32 block_cnt= 2 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 192 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 176 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 176 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 160 used= 16 count= 2 avg_used= 8 block_cnt= 2 chunk_cnt= 2 mod=ObLogEXTHandler [MEMORY] hold= 128 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 112 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 112 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 112 used= 48 count= 1 avg_used= 48 block_cnt= 1 chunk_cnt= 1 mod=[T]TSITabletTab [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=[T]TSIDDLVar [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=[T]TSILastOper [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 727,214,896 used= 719,651,540 count= 32,387 avg_used= 22,220 mod=SUMMARY [2024-06-24 16:58:39.404025] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=185] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 136,314,880 used= 135,249,920 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 135,249,920 used= 135,188,040 count= 65 avg_used= 2,079,816 block_cnt= 65 chunk_cnt= 65 mod=Memstore [MEMORY] hold= 135,249,920 used= 135,188,040 count= 65 avg_used= 2,079,816 mod=SUMMARY [2024-06-24 16:58:39.404046] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,496 count= 1 avg_used= 722,496 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,496 count= 1 avg_used= 722,496 mod=SUMMARY [2024-06-24 16:58:39.404065] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 140,509,184 used= 136,763,504 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 129,217,136 used= 117,812,699 count= 5,478 avg_used= 21,506 block_cnt= 5,478 chunk_cnt= 67 mod=SqlPhyPlan [MEMORY] hold= 5,543,104 used= 5,300,896 count= 529 avg_used= 10,020 block_cnt= 529 chunk_cnt= 67 mod=SqlPlanCache [MEMORY] hold= 2,001,536 used= 1,938,368 count= 977 avg_used= 1,984 block_cnt= 246 chunk_cnt= 66 mod=CreateContext [MEMORY] hold= 1,728 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 136,763,504 used= 125,053,563 count= 6,986 avg_used= 17,900 mod=SUMMARY [2024-06-24 16:58:39.404092] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,944 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,848 used= 59,018 count= 263 avg_used= 224 block_cnt= 20 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,944 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-06-24 16:58:39.404111] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 150,994,944 used= 147,603,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 147,603,456 used= 147,328,896 count= 286 avg_used= 515,136 block_cnt= 286 chunk_cnt= 72 mod=CoStack [MEMORY] hold= 147,603,456 used= 147,328,896 count= 286 avg_used= 515,136 mod=SUMMARY [2024-06-24 16:58:39.404138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 232,783,872 used= 232,783,872 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 232,783,872 used= 0 count= 111 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 232,783,872 used= 0 count= 111 avg_used= 0 mod=SUMMARY [2024-06-24 16:58:39.404158] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 14,680,064 used= 13,148,160 limit= 3,650,722,200 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,552,448 used= 7,608,556 count= 116 avg_used= 65,591 block_cnt= 116 chunk_cnt= 6 mod=L_TabletPool [MEMORY] hold= 4,194,304 used= 4,186,112 count= 64 avg_used= 65,408 block_cnt= 64 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 13,148,160 used= 12,194,732 count= 182 avg_used= 67,004 mod=SUMMARY [2024-06-24 16:58:39.404179] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 7,344,640 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 7,344,640 used= 7,285,248 count= 918 avg_used= 7,936 block_cnt= 918 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 7,344,640 used= 7,285,248 count= 918 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:39.404198] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 73,536 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=LobAllocator [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 73,536 used= 73,344 count= 2 avg_used= 36,672 mod=SUMMARY [2024-06-24 16:58:39.404215] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 33,600 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,600 used= 31,721 count= 26 avg_used= 1,220 block_cnt= 5 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 33,600 used= 31,721 count= 26 avg_used= 1,220 mod=SUMMARY [2024-06-24 16:58:39.404244] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 6,311,936 used= 5,878,656 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 3,182,528 used= 3,153,728 count= 3 avg_used= 1,051,242 block_cnt= 3 chunk_cnt= 3 mod=MEMTABLE_ARENA [MEMORY] hold= 2,688,128 used= 2,666,496 count= 336 avg_used= 7,936 block_cnt= 336 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 5,878,656 used= 5,828,160 count= 340 avg_used= 17,141 mod=SUMMARY [2024-06-24 16:58:39.404270] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 96,000 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 1 mod=MdsTable [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:39.404294] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= SCHEMA_SERVICE hold= 2,097,152 used= 8,000 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenCac [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:39.404314] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2024-06-24 16:58:39.404338] INFO [LIB] operator() (ob_malloc_allocator.cpp:542) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 2,043,682,816 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 301,744,128 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 8,388,608 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 178,257,920 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 10,485,760 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 12,582,912 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 112,066,560 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 193,744,896 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 1,220,120,576 limit= 9,223,372,036,854,775,807 [2024-06-24 16:58:39.404676] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 301,744,128 used= 256,270,096 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 26,984,448 used= 25,303,776 count= 366 avg_used= 69,136 block_cnt= 366 chunk_cnt= 41 mod=[T]ObSessionDIB [MEMORY] hold= 24,014,848 used= 23,941,952 count= 28 avg_used= 855,069 block_cnt= 28 chunk_cnt= 19 mod=IoControl [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,502,144 used= 10,477,568 count= 64 avg_used= 163,712 block_cnt= 64 chunk_cnt= 23 mod=Iteratorget_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129714, mem_used=326519808) [2024-06-24 16:58:39.434133] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:39.436347] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=29] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:39.436396] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=48] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:39.436442] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:39.436594] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=30] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:39.436726] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=126] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:39.436755] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:39.436777] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219511204349001, v:0}) [2024-06-24 16:58:39.436791] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:39.436808] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:39.436828] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:39.436857] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:39.436880] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:39.436894] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:39.455633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.462029] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=30] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:39.462708] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519462525000, start_id=1719219519462525000, end_id=1719219519462525001) [2024-06-24 16:58:39.463810] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:39.463917] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516741149000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:39.480086] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.480888] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:39.500441] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974EA-0-0] [lt=43][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:39.503446] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974EB-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:39.509033] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974ED-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:39.512111] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974EE-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:39.515310] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [1312][T1004_DupTbLeas][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:39.515386] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [1312][T1004_DupTbLeas][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1004 and flag like "%DUPLICATE%", tenant_id=1004, exec_tenant_id=1003, need_member_list=false) [2024-06-24 16:58:39.515529] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974EF-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:39.516817] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E931-0-0] [lt=28] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1719219519516800}) [2024-06-24 16:58:39.516867] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D066-0-0] [lt=27] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219519516840, sql_renew_time:1719219519516840, is_mark_fail:false}]) [2024-06-24 16:58:39.516912] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D066-0-0] [lt=43] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1719219519516800}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219519516840, sql_renew_time:1719219519516840, is_mark_fail:false}]) [2024-06-24 16:58:39.518143] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E931-0-0] [lt=21] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:39.518241] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E931-0-0] [lt=18][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:39.522231] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=12] start to print blacklist info [2024-06-24 16:58:39.522348] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=16] ls blacklist refresh finish(cost_time=6510) [2024-06-24 16:58:39.524072] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219519523807000, start_id=1719219519523807000, end_id=1719219519523807001) [2024-06-24 16:58:39.524595] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=392, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:39.524656] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=19, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:39.531844] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [162298][AutoLSLoc][T1003][YB42AC141156-00061B9D8A40C5C6-0-0] [lt=37][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1748, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:39.537111] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1192][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=51] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:39.540414] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974F8-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:39.543458] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974F9-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:39.543855] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC0D-0-0] [lt=33][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103415635223, cache_obj->added_lc()=false, cache_obj->get_object_id()=9361, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:39.548190] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974FB-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:39.550044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283370942464, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:39.550804] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519550159000, start_id=1719219519550159000, end_id=1719219519550159001) [2024-06-24 16:58:39.550941] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:39.550995] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:39.551074] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:39.551101] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:39.551165] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:39.551196] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:39.551239] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5451-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:39.555642] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5462-0-0] [lt=7] get number(ret=0, service_type_=0, range=1, base_id=1719219519555425000, start_id=1719219519555425000, end_id=1719219519555425001) [2024-06-24 16:58:39.555691] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.558644] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10744E6-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1719219519558585000, start_id=1719219519558585000, end_id=1719219519558585001) [2024-06-24 16:58:39.563469] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB974FE-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:39.565561] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82200000, replace_num=100000) [2024-06-24 16:58:39.565593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:39.567191] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:39.567239] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=402, avg_log_submit_to_slide_time=410) [2024-06-24 16:58:39.569546] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8260, avg_group_log_size=516) [2024-06-24 16:58:39.569575] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8260) [2024-06-24 16:58:39.569920] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8260) [2024-06-24 16:58:39.580144] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.581122] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1719219519581118, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-06-24 16:58:39.583416] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D42A-0-0] [lt=14] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.586780] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13736, offset=3449978}, end_cursor:ObLogCursor{file_id=1, log_id=13737, offset=3450251}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c8c050, len:2950, log_data_len:273, seq:13736, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:39.588038] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519587002000, start_id=1719219519587002000, end_id=1719219519587002001) [2024-06-24 16:58:39.589112] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D90E-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219519589108000, start_id=1719219519589108000, end_id=1719219519589108001) [2024-06-24 16:58:39.589518] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8261) [2024-06-24 16:58:39.589556] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=391, avg_log_submit_to_slide_time=401) [2024-06-24 16:58:39.590195] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=29] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13737, offset=3450251}, end_cursor:ObLogCursor{file_id=1, log_id=13738, offset=3450516}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c90050, len:2677, log_data_len:265, seq:13737, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:39.602608] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9750A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:39.605585] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9750B-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:39.609808] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219519609118000, start_id=1719219519609118000, end_id=1719219519609118001) [2024-06-24 16:58:39.610808] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:39.618328] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8387) [2024-06-24 16:58:39.618379] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=8387) [2024-06-24 16:58:39.618421] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=14, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=401, avg_log_submit_to_slide_time=410) [2024-06-24 16:58:39.620566] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:39.621020] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:39.628984] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D4C-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219519628036000, start_id=1719219519628036000, end_id=1719219519628036001) [2024-06-24 16:58:39.640341] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=436, avg_log_submit_to_slide_time=451) [2024-06-24 16:58:39.644535] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=22] success to update min reserved snapshot(reserved_snapshot=1719217706800618000, duration=1800, snapshot_gc_ts=1719219506800618000) [2024-06-24 16:58:39.644573] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=18] update reserved snapshot finished(cost_ts=49, reserved_snapshot=1719217706800618000) [2024-06-24 16:58:39.655750] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.656909] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9751D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:39.662770] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519661821000, start_id=1719219519661821000, end_id=1719219519661821001) [2024-06-24 16:58:39.667209] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=380, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:39.667240] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:39.667253] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:39.667272] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=456, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:39.667286] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:39.680202] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.692119] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A55FB-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.694261] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9238-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.694528] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573AE-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.696298] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=44] LogLoopThread round_cost_time(us)(round_cost_time=19) [2024-06-24 16:58:39.698467] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573B5-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.698666] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A560D-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.699661] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074564-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.700028] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:39.700737] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEC2-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.701873] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9245-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.702158] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFA6-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.702528] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A561E-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.703231] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5621-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.703539] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5622-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.705412] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C924C-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.707212] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5633-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.707810] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573C5-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.708190] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5636-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.708522] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9252-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.709182] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9253-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.709385] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A563E-0-0] [lt=10][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.709493] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9254-0-0] [lt=10][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.710341] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074571-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.710869] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9255-0-0] [lt=10][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.711073] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169029-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.711143] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573CB-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.713697] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074576-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.713781] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1445][T1004_L0_G0][T1004][YB42AC141156-00061B9D997125D3-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219519713505000, start_id=1719219519713505000, end_id=1719219519713505001) [2024-06-24 16:58:39.714195] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573D1-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.714291] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D57-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.714798] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFB8-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.715818] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9264-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.716005] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116902F-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.716361] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A565F-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.716388] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573D4-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.716564] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:39.716618] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=37] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1239) [2024-06-24 16:58:39.716999] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD071-0-0] [lt=36][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.717014] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5662-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.717228] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169030-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.717565] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [1204][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=31] BlockGCTimerTask success(ret=0, cost_time_us=25, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1004", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):44236, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):44236, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):226, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:39.718434] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=9] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:39.718562] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C926E-0-0] [lt=14][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.718781] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A566B-0-0] [lt=10][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.719281] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074581-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.719361] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D5F-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.719385] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169034-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.719492] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=23] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:39.719566] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=20] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516806320000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:39.720080] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5674-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.720433] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1430][T1004_L0_G0][T1004][YB42AC141156-00061B9D9D90CD4D-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219519719873000, start_id=1719219519719873000, end_id=1719219519719873001) [2024-06-24 16:58:39.720541] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:39.720851] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9273-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.721091] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573D6-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.721113] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A567A-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.721904] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074586-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.722114] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573D7-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.722441] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:39.722455] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074587-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.722474] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:39.722511] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=103054221, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:39.722606] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5682-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.722750] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D65-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.723110] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573D8-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.723671] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=15] ====== tenant freeze timer task ====== [2024-06-24 16:58:39.723694] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD079-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.723816] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D66-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.723906] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573DA-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.723923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=50444, mem_used=172618752) [2024-06-24 16:58:39.724127] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82058-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.724366] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219519724067000, start_id=1719219519724067000, end_id=1719219519724067001) [2024-06-24 16:58:39.724761] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A568E-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.725149] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD07C-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.725384] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9283-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.725413] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFCF-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.725926] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC129D7-0-0] [lt=48][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.726060] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D43E-0-0] [lt=19] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.726135] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD07D-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.726172] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D440-0-0] [lt=20] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:39.726292] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D6E-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.726589] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEE0-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.730257] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=16] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:39.733265] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D73-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.733477] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56A1-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.733524] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8205C-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.734303] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169040-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.734405] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D74-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.734583] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074595-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.734809] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8205D-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.735943] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEE6-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.736166] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82060-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.736598] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56AA-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.737165] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD084-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.737245] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEE7-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.737441] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56AC-0-0] [lt=39][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.737716] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573DD-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.738591] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107459F-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.739743] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEED-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.740422] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D81-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.740456] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56B5-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.741245] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56B6-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.741341] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10745A4-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.741357] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D82-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.742158] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10745A5-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.742323] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD08A-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.742599] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEF0-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.743183] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169048-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.743546] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D86-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.743642] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10745A9-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.744213] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFE2-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.745979] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041D89-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219519745232000, start_id=1719219519745232000, end_id=1719219519745232001) [2024-06-24 16:58:39.746030] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56C6-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219519745232000, start_id=1719219519745232001, end_id=1719219519745232002) [2024-06-24 16:58:39.746109] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92B6-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.746199] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116904C-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219519745232000, start_id=1719219519745232002, end_id=1719219519745232003) [2024-06-24 16:58:39.746647] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:39.746956] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116904E-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.747070] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92B8-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.747836] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56CA-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.748153] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8206B-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.748346] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFE7-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.748458] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:39.748563] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219517123751000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:39.749422] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [1569][T1003_DupTbLeas][T1003][Y0-0000000000000000-0-0] [lt=11][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:39.749480] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [1569][T1003_DupTbLeas][T1003][Y0-0000000000000000-0-0] [lt=17][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1003 and flag like "%DUPLICATE%", tenant_id=1003, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:39.750576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283368845312, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:39.751016] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519750492000, start_id=1719219519750492000, end_id=1719219519750492001) [2024-06-24 16:58:39.751097] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:39.751135] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:39.751556] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=365, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:39.751593] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=14, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:39.751654] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=8, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:39.751684] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=429, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:39.751701] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:39.752290] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFEA-0-0] [lt=33][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.752780] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92C2-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.753275] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCDEF8-0-0] [lt=41][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.753781] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92C5-0-0] [lt=13][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.754221] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFEC-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.754228] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573EC-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.755330] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169053-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.755791] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573EE-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.755811] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.756275] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10745C0-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.756491] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169054-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.756978] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573EF-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.757408] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10745C2-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.757677] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8206C-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.757766] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92CA-0-0] [lt=11][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.758160] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19EFF2-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.758967] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56E6-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.759355] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8206F-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.760138] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116905E-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.760460] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56EB-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.760983] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56EC-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.763707] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [163826][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=2620, bkt_cnt=7851) [2024-06-24 16:58:39.765643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:39.767281] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:39.767296] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:39.770520] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=22] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:39.770568] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:39.770590] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=19] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:39.770605] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=13] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1218) [2024-06-24 16:58:39.772389] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A56F4-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.775060] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169065-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:39.780261] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.787001] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221494472, support_ssl=false) [2024-06-24 16:58:39.787080] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=30] sm conn init succ(conn.sessid_=3221494472, sess.client_addr_="172.20.17.86:49512") [2024-06-24 16:58:39.787103] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f47833c2030, session_id:3221494472, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:39.787168] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494472, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:39.787199] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494472, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:39.787216] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494472, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:39.787240] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=23] mark session id unused(conn.sessid_=3221494472) [2024-06-24 16:58:39.787253] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162497][sql_nio7][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494472, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:39.788182] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219519787486000, start_id=1719219519787486000, end_id=1719219519787486001) [2024-06-24 16:58:39.810338] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219519809654000, start_id=1719219519809654000, end_id=1719219519809654001) [2024-06-24 16:58:39.825524] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=11] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=39, mem_used=49913856) [2024-06-24 16:58:39.825555] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] release old cannot free more memory [2024-06-24 16:58:39.825565] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=42, size_used=0, mem_used=49913856) [2024-06-24 16:58:39.845266] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9755D-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:39.847676] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219519846630000, start_id=1719219519846630000, end_id=1719219519846630001) [2024-06-24 16:58:39.847714] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=33] handle gts request statistics(total_rt=872, total_cnt=100, avg_rt=8.633663366336634226e+00, avg_cnt=1.000000000000000000e+01) [2024-06-24 16:58:39.847821] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=28] submit log success(service_type_=0, last_id=1719219536480480000, limited_id=1719219536480480000) [2024-06-24 16:58:39.847836] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=14] submit log with lock success(service_type_=0, last_id=1719219536480480000, limited_id=1719219536480480000) [2024-06-24 16:58:39.848176] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA116904C-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1719219536480480000, latest_scn={val:1719219519847687001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219517342441001, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:39.848264] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA116904C-0-0] [lt=86] handle submit callback(service_type_=0, success=true, used_ts=444, log_ts={val:1719219519847687001, v:0}, limited_id=1719219536480480000) [2024-06-24 16:58:39.848287] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA116904C-0-0] [lt=22] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:39.848305] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA116904C-0-0] [lt=17] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:39.848402] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9755E-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:39.854084] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97560-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:39.855869] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:39.855904] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=34] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:39.855924] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.856818] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=31] current monitor number(seq_=-1) [2024-06-24 16:58:39.856878] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97561-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:39.859698] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97562-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:39.863067] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219519862482000, start_id=1719219519862482000, end_id=1719219519862482001) [2024-06-24 16:58:39.863674] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] get_max_applied_scn(scn={val:1719219519745232002, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:517671704}, palf_committed_end_scn_:{val:1719219519745232002, v:0}, last_check_scn_:{val:1719219519745232002, v:0}, max_applied_cb_scn_:{val:1719219519745232002, v:0}}) [2024-06-24 16:58:39.873697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.873701] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.873732] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.873721] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.873943] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874071] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874181] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874466] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874529] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874528] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874549] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874556] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874708] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874704] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874707] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874731] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874719] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874721] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874767] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874766] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874778] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874788] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874782] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874787] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874804] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.874829] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:39.880320] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.883772] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9756A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:39.886583] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9756B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:39.891067] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9756D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:39.893821] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:39.893927] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:39.894119] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:39.894182] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:39.894337] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:39.894409] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:39.894506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97570-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:39.906711] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97571-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:39.911570] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:39.924275] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219519923538000, start_id=1719219519923538000, end_id=1719219519923538001) [2024-06-24 16:58:39.928090] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=19] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16489, offset=3756723}, end_cursor:ObLogCursor{file_id=1, log_id=16490, offset=3756996}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c94050, len:3405, log_data_len:273, seq:16489, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:39.930218] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FF-0-0] [lt=32] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334374136924743652e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.949462451897566950e+01) [2024-06-24 16:58:39.932179] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FF-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1719219519931999000, start_id=1719219519931999000, end_id=1719219519931999001) [2024-06-24 16:58:39.932280] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FF-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:39.932306] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D8FF-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7764) [2024-06-24 16:58:39.932680] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:39.932736] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7764) [2024-06-24 16:58:39.932777] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=406, avg_log_submit_to_slide_time=416) [2024-06-24 16:58:39.933352] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=17] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16490, offset=3756996}, end_cursor:ObLogCursor{file_id=1, log_id=16491, offset=3757261}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c98050, len:3132, log_data_len:265, seq:16490, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:39.945291] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9757F-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:39.948058] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97580-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:39.951085] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219519951043000, start_id=1719219519951043000, end_id=1719219519951043001) [2024-06-24 16:58:39.951124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283358339072, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:39.951471] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219519951468, bytes: 170795843, bw: 0.039949 MB/s, add_ts: 1007620, add_bytes: 42209 [2024-06-24 16:58:39.955930] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.965737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:39.967007] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:39.967046] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:39.967073] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:39.967095] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:39.967131] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:39.967439] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=347, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:39.967458] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:39.967487] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=434, avg_log_submit_to_slide_time=441) [2024-06-24 16:58:39.975046] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1104) [2024-06-24 16:58:39.980383] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:39.988284] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219519988219000, start_id=1719219519988219000, end_id=1719219519988219001) [2024-06-24 16:58:39.997097] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97594-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.002890] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:40.010417] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520010399000, start_id=1719219520010399000, end_id=1719219520010399001) [2024-06-24 16:58:40.011355] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:40.011406] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=38] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1239) [2024-06-24 16:58:40.019590] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [1462][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=49] BlockGCTimerTask success(ret=0, cost_time_us=8, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1003", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):4915, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):4915, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):134, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:40.027275] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D067-0-0] [lt=32] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:40.027722] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D067-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219520027692, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:40.027764] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D067-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1719219520027203}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219520027692, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:40.041698] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 351.50) [2024-06-24 16:58:40.041717] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:40.041790] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 373.50) [2024-06-24 16:58:40.041800] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:40.041821] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041835] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041848] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041855] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041865] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041879] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041888] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041895] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041901] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041910] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041921] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041929] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041938] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.041954] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:40.054705] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:40.055987] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.063071] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219520063064000, start_id=1719219520063064000, end_id=1719219520063064001) [2024-06-24 16:58:40.067047] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] tx gc loop thread is running(MTL_ID()=1004) [2024-06-24 16:58:40.067073] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] try gc retain ctx [2024-06-24 16:58:40.067107] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] get_max_applied_scn(scn={val:1719219519847687000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:45077297}, palf_committed_end_scn_:{val:1719219519847687000, v:0}, last_check_scn_:{val:1719219519847687000, v:0}, max_applied_cb_scn_:{val:1719219519847687000, v:0}}) [2024-06-24 16:58:40.067143] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=32] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:40.069562] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=105] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219517843757000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:40.070954] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=46] LogLoopThread round_cost_time(us)(round_cost_time=11) [2024-06-24 16:58:40.072014] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=118] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219517843757000, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:40.074776] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:40.074818] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:40.074849] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:40.074873] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:40.075135] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=313, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:40.075155] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=10, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:40.075189] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:40.075224] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=373, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:40.075243] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=30, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:40.075364] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=349, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:40.075383] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:40.075401] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:40.075417] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=447, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:40.075432] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=23, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:40.080442] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.095927] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.095968] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=728, mem_used=2079744) [2024-06-24 16:58:40.096095] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096600] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096659] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096657] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096655] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096883] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.096889] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097101] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097104] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097251] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097279] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097298] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097329] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097385] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097428] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097502] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097552] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097617] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097654] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097681] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097678] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097676] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097700] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097716] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097731] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097734] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097727] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097774] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097822] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.097883] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098040] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098064] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098154] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098190] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098308] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098484] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098629] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098612] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098613] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098689] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098699] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098701] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=61] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098727] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098732] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098729] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098730] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098728] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098762] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098797] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098868] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.098965] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.111646] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:40.111671] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:40.111704] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=73557700, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:40.113825] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1F-0-0] [lt=42] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:40.113861] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD1F-0-0] [lt=28] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=43) [2024-06-24 16:58:40.116958] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=17] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:67521, max_lsn:53474050, max_scn:{val:1719219519923538001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:53474050}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:11531010}}, last_submit_lsn:{lsn:53473928}, last_submit_end_lsn:{lsn:53474050}, last_submit_log_id:67521, last_submit_log_pid:1, max_flushed_lsn:{lsn:53473928}, max_flushed_end_lsn:{lsn:53474050}, max_flushed_log_pid:1, committed_end_lsn:{lsn:53474050}, last_slide_log_id:67521, last_slide_scn:{val:1719219519923538001, v:0}, last_slide_lsn:{lsn:53473928}, last_slide_end_lsn:{lsn:53474050}, last_slide_log_pid:1, last_slide_log_accum_checksum:634621148, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f47b6888530}, [StateMgr]={this:0x7f47b688c2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:67522, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213258395201, palf_role_change_cb:0x7f47b6892cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f47b6889c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1/1/meta", dir_fd:657, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f47b688e478, flashback_version:0}, log_storage:{log_tail:{lsn:53474050}, readable_log_tail:{lsn:53474050}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1/1/log", dir_fd:658, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:13630718, block_header_serialize_buf_:0x7f47b6890138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213258395305, this:0x7f47b688c9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213258395809, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f47b688c430}) [2024-06-24 16:58:40.117199] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=238] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219520040522, last_flushed_end_lsn:{lsn:53474050}}]) [2024-06-24 16:58:40.117215] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=13] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=67522, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219520040522, last_flushed_end_lsn:{lsn:53474050}}]) [2024-06-24 16:58:40.117646] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:40.117674] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:40.117688] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=12] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:40.117695] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=6] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1231) [2024-06-24 16:58:40.121831] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=61] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:40.124194] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [162968][T1_TenantWeakRe][T1][YB42AC141156-00061B9D89B1395C-0-0] [lt=30] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=199) [2024-06-24 16:58:40.124427] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219520124260000, start_id=1719219520124260000, end_id=1719219520124260001) [2024-06-24 16:58:40.134019] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:40.151229] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219520150657000, start_id=1719219520150657000, end_id=1719219520150657001) [2024-06-24 16:58:40.151697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283360456704, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:40.152587] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DC-0-0] [lt=24] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:40.152638] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DC-0-0] [lt=47] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:40.154346] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F7-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:40.154379] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F7-0-0] [lt=30] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:40.156046] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.158702] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975CD-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:40.161556] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975CE-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:40.165797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:40.166970] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975D0-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:40.167167] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=100] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1089) [2024-06-24 16:58:40.167485] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=12, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:40.167502] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:40.167516] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=396, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:40.167525] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=8] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:40.169825] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975D1-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:40.172665] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975D2-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:40.175389] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=20] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:40.180539] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:40.180565] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:40.180583] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.188387] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520187657000, start_id=1719219520187657000, end_id=1719219520187657001) [2024-06-24 16:58:40.196489] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975DC-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:40.199319] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975DD-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.201615] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:40.203743] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB975DF-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:40.206612] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:40.206730] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:40.206938] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:40.207004] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:40.207172] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:40.207248] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:40.207353] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE139-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:40.210339] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520209858000, start_id=1719219520209858000, end_id=1719219520209858001) [2024-06-24 16:58:40.220120] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE13A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:40.226803] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [803][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:40.228913] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [939][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=24] report RowHolderMapper summary info(count=2620, bkt_cnt=7836) [2024-06-24 16:58:40.238952] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:40.239002] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=27] get_max_applied_scn(scn={val:1719219520150657000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:73558878}, palf_committed_end_scn_:{val:1719219520187657000, v:0}, last_check_scn_:{val:1719219520187657000, v:0}, max_applied_cb_scn_:{val:1719219520150657000, v:0}}) [2024-06-24 16:58:40.239038] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=32] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:40.240257] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:40.240285] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:40.240676] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3411) [2024-06-24 16:58:40.240734] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3411) [2024-06-24 16:58:40.240781] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:40.240802] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=480, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:40.240820] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=34, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:40.241108] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=88] succ to get rec scn(*this={this:0x7f46f0604030, ls_id:{id:1}, tenant_id:1003, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216321111181000, v:0}, last_push_gc_task_ts_:1719216953731290, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:40.241141] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=32] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46f1df0080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216953736744, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46f1df0080, snapshot_version:{val:1719216953736744, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:40.241181] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=33] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:40.241311] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:40.241412] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46f1d8d790}, min_rec_scn={val:1719216953754927000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:40.241440] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:40.241461] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=0, rec_log_ts={val:1719219517910315001, v:0}) [2024-06-24 16:58:40.241474] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:40.241487] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:40.241506] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216953754927000, v:0}, checkpoint_scn_in_ls_meta={val:1719216953754927000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:40.241536] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:40.241558] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:40.241573] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:40.253182] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:40.253226] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=34] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:40.253247] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1238) [2024-06-24 16:58:40.256104] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.260886] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE148-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:40.263176] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520262705000, start_id=1719219520262705000, end_id=1719219520262705001) [2024-06-24 16:58:40.263883] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE149-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:40.274679] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=158] tx gc loop thread is running(MTL_ID()=1003) [2024-06-24 16:58:40.274709] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=28] try gc retain ctx [2024-06-24 16:58:40.277017] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=15] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1003, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:40.279365] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=17] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:40.279394] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=29] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:40.279389] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C727-0-0] [lt=12] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:40.279418] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C727-0-0] [lt=24] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:40.280559] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.291211] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=19] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:40.291292] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:40.291311] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=17] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:40.291357] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=16] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1677877248, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5838315520, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:40.291441] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:40.291456] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=15] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=416563, drift_size_=0, pre_drift_size=30600560, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:40.291499] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=13] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:40.291560] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=16] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:40.291573] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=12] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:40.291614] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=13] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:40.291742] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=43] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:40.291760] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=17] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:40.298011] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A8-0-0] [lt=48][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:40.298040] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A8-0-0] [lt=27][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:40.303504] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [162977][T1_ArcSender][T1][YB42AC141156-00061B9D8760C0E5-0-0] [lt=22][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:40.305742] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [348][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=48] ====== traversal_flush timer task ====== [2024-06-24 16:58:40.305880] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BB-0-0] [lt=20] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219517342441001, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:40.306016] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BB-0-0] [lt=86] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219517342441001, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:40.306084] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BB-0-0] [lt=66] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:40.317240] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE15A-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.324434] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219520323924000, start_id=1719219520323924000, end_id=1719219520323924001) [2024-06-24 16:58:40.324518] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3411, avg_group_log_size=379) [2024-06-24 16:58:40.324546] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3411) [2024-06-24 16:58:40.326126] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=111928, mem_used=264127488) [2024-06-24 16:58:40.331993] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:397) [162151][ServerTracerTim][T0][YB42AC141156-00061B9D86E0C5CB-0-0] [lt=33] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-06-24 16:58:40.342962] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:40.344313] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=49] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2024-06-24 16:58:40.346203] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=35] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1004) [2024-06-24 16:58:40.346234] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1001) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=29] no transfer partition job [2024-06-24 16:58:40.346256] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1031) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=16] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer={value_str:"True"}) [2024-06-24 16:58:40.348610] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=11] get number(ret=0, service_type_=0, range=1, base_id=1719219520348199000, start_id=1719219520348199000, end_id=1719219520348199001) [2024-06-24 16:58:40.348665] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=33] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:40.349851] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=20] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1004, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2024-06-24 16:58:40.349906] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:482) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=38] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2024-06-24 16:58:40.351217] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219520350312000, start_id=1719219520350312000, end_id=1719219520350312001) [2024-06-24 16:58:40.351858] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [WRS] update tenant weak read server version(tenant_id=1003, server_version={version:{val:1719219520187657000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1719219520351828}, version_delta=164200) [2024-06-24 16:58:40.352213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283354165248, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:40.353489] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2024-06-24 16:58:40.353583] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34B-0-0] [lt=28] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1004, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1002, status:0}], ls_array_=[{tenant_id:1004, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1002, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1719213373528854, last_statistic_bg_stat_time=1719216987199453, last_statistic_schema_version=1719216919372024, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2024-06-24 16:58:40.356164] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.365874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:40.367287] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:40.367322] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:40.374961] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1104, avg_group_log_size=122) [2024-06-24 16:58:40.374995] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1104) [2024-06-24 16:58:40.375033] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=9760, avg_group_log_size=542) [2024-06-24 16:58:40.375059] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=10270) [2024-06-24 16:58:40.375292] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1104) [2024-06-24 16:58:40.375651] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [960][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:40.375835] INFO [MDS] flush (mds_table_mgr.cpp:172) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BB-0-0] [lt=30] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219527830421000, latest_log_ts:{val:1719219511204349001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:40.375961] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BB-0-0] [lt=121] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:40.380616] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.388485] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219520388321000, start_id=1719219520388321000, end_id=1719219520388321001) [2024-06-24 16:58:40.410426] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219520409442000, start_id=1719219520409442000, end_id=1719219520409442001) [2024-06-24 16:58:40.410492] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:40.410523] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:40.410922] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=381, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:40.410959] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:40.410989] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:40.411016] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=441, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:40.411034] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=24, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:40.420584] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129736, mem_used=326519808) [2024-06-24 16:58:40.427837] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2024-06-24 16:58:40.429871] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219520429489000, start_id=1719219520429489000, end_id=1719219520429489001) [2024-06-24 16:58:40.431399] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=39] run rewrite rule refresh task(rule_mgr_->tenant_id_=1003) [2024-06-24 16:58:40.433383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219520432630000, start_id=1719219520432630000, end_id=1719219520432630001) [2024-06-24 16:58:40.434286] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [162311][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=24] runTimer to refresh locality_info(ret=0) [2024-06-24 16:58:40.435704] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=32] set_server_locality_array success(server_locality_array=[{inited:true, addr:"172.20.17.86:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1719213306412144, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2024-06-24 16:58:40.435744] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=32] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2024-06-24 16:58:40.435757] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2024-06-24 16:58:40.435771] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2024-06-24 16:58:40.435781] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=10] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2024-06-24 16:58:40.435798] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=6] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2024-06-24 16:58:40.435806] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=8] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2024-06-24 16:58:40.435813] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=5] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1003, primary_zone=RANDOM) [2024-06-24 16:58:40.435820] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=7] add_locality_zone success(locality_zone={tenant_id:1003, region_priority:18446744073709551615}) [2024-06-24 16:58:40.435826] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=5] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1004, primary_zone=RANDOM) [2024-06-24 16:58:40.435835] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=9] add_locality_zone success(locality_zone={tenant_id:1004, region_priority:18446744073709551615}) [2024-06-24 16:58:40.435843] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=5] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}, {tenant_id:1003, region_priority:18446744073709551615}, {tenant_id:1004, region_priority:18446744073709551615}]}) [2024-06-24 16:58:40.443367] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1364][T1004_LCLSender][T1004][Y0-0000000000000000-0-0] [lt=42] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47231fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:40.456221] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.461970] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:40.463308] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520463274000, start_id=1719219520463274000, end_id=1719219520463274001) [2024-06-24 16:58:40.463848] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219519847687003, v:0}, new_max_version={val:1719219519847687003, v:0}, last_min_version={val:1719219519847687001, v:0}, last_max_version={val:1719219519847687001, v:0}, total_time_us=2545, delta_us=616160) [2024-06-24 16:58:40.463883] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219519847687003, v:0}, min_version={val:1719219519847687003, v:0}, max_version={val:1719219519847687003, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:40.463928] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=31] run rewrite rule refresh task(rule_mgr_->tenant_id_=1004) [2024-06-24 16:58:40.465954] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219520465389000, start_id=1719219520465389000, end_id=1719219520465389001) [2024-06-24 16:58:40.475366] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=342, avg_log_submit_to_slide_time=353) [2024-06-24 16:58:40.478289] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE195-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:40.480633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.480993] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=20] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:40.481309] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE196-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:40.486943] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE198-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:40.489908] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE199-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:40.492919] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE19A-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:40.494294] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2024-06-24 16:58:40.496325] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219520495961000, start_id=1719219520495961000, end_id=1719219520495961001) [2024-06-24 16:58:40.518048] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB977AE-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:40.520924] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB977B0-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.522679] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1719219520323924000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198749, in_cluster_service=true, cluster_version={val:1719219520124260000, v:0}, min_cluster_version={val:1719219520124260000, v:0}, max_cluster_version={val:1719219520124260000, v:0}, get_cluster_version_err=0, cluster_version_delta=398413, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60518, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219313404268000, v:0}, local_cluster_delta=207118405, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:40.523006] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [918][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:857, free_obj_hold_cnt:56, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:56, free_obj_hold_cnt:0, allocator used:3673096, allocator total:3673096}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=7698952, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:13, free_obj_hold_cnt:45, allocator used:118784, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:40.524391] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=66] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}) [2024-06-24 16:58:40.524681] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] get number(ret=0, service_type_=0, range=1, base_id=1719219520524424000, start_id=1719219520524424000, end_id=1719219520524424001) [2024-06-24 16:58:40.525114] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=393, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:40.525147] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:40.525540] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A4-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:40.528275] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:40.528386] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:40.528586] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:40.528669] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:40.528836] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:40.528912] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:40.529015] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:40.539950] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1A6-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:40.548290] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169082-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219520547630000, start_id=1719219520547630000, end_id=1719219520547630001) [2024-06-24 16:58:40.551260] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC0F-0-0] [lt=31][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103416642621, cache_obj->added_lc()=false, cache_obj->get_object_id()=9362, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:40.551373] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219520550802000, start_id=1719219520550802000, end_id=1719219520550802001) [2024-06-24 16:58:40.552744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283354165248, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:40.553848] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169086-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:40.554198] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169086-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:40.554469] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169086-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:40.554757] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169086-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:40.555233] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169086-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:40.556280] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.558980] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-06-24 16:58:40.561025] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520560262000, start_id=1719219520560262000, end_id=1719219520560262001) [2024-06-24 16:58:40.565952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:40.567831] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1089) [2024-06-24 16:58:40.567865] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=9] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=377, avg_log_submit_to_slide_time=385) [2024-06-24 16:58:40.570105] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8806, avg_group_log_size=518) [2024-06-24 16:58:40.570140] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8806) [2024-06-24 16:58:40.570487] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8806) [2024-06-24 16:58:40.580250] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1B2-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:40.580697] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.583207] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1B3-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:40.583646] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1003) [2024-06-24 16:58:40.583679] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=28] start lib cache evict(tenant_id=1003, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:40.583700] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1003, cache_evict_num=0, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:40.583719] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=17] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:40.588606] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520587724000, start_id=1719219520587724000, end_id=1719219520587724001) [2024-06-24 16:58:40.588746] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1719219520588735, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-06-24 16:58:40.590391] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=144, alloc_obj_list=[{obj_id:6, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:7, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:182, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:183, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:195, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:196, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195296}, {obj_id:199, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198764}, {obj_id:232, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197576}, {obj_id:237, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:238, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:242, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:246, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:248, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:250, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:251, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:252, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:253, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:254, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:255, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:256, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190960}, {obj_id:257, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:258, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:259, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:265, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:267, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193914}, {obj_id:268, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:269, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:270, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:271, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:273, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245001}, {obj_id:274, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238477}, {obj_id:278, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303661}, {obj_id:280, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250140}, {obj_id:282, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265464}, {obj_id:283, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260287}, {obj_id:285, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:286, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:287, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:288, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:289, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:290, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:291, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:292, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:293, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:294, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:296, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:297, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:298, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:299, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:300, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:302, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:306, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:307, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:308, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:310, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:311, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:313, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:314, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:315, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192384}, {obj_id:316, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:317, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:318, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179373}, {obj_id:319, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:320, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:321, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:322, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214835}, {obj_id:323, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257749}, {obj_id:324, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257679}, {obj_id:325, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:301211}, {obj_id:326, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:322954}, {obj_id:327, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255184}, {obj_id:328, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253823}, {obj_id:329, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:326827}, {obj_id:330, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262876}, {obj_id:331, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283304}, {obj_id:332, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296168}, {obj_id:333, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:261538}, {obj_id:334, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:285869}, {obj_id:335, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300008}, {obj_id:336, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183813}, {obj_id:337, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215145}, {obj_id:338, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252630}, {obj_id:339, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273088}, {obj_id:340, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280836}, {obj_id:341, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275631}, {obj_id:342, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:284691}, {obj_id:343, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250120}, {obj_id:344, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246226}, {obj_id:345, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247565}, {obj_id:346, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242359}, {obj_id:347, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:348, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:349, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:350, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:351, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265421}, {obj_id:352, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269241}, {obj_id:353, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270506}, {obj_id:354, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276928}, {obj_id:355, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267956}, {obj_id:356, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273080}, {obj_id:357, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280749}, {obj_id:358, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292309}, {obj_id:359, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278185}, {obj_id:360, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288460}, {obj_id:361, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288428}, {obj_id:362, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303857}, {obj_id:363, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:364, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:365, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:366, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:367, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:368, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:369, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419863}, {obj_id:371, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312858}, {obj_id:372, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417607}, {obj_id:373, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:374, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:375, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:376, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:377, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:378, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:379, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:380, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:384, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:385, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200158}, {obj_id:386, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332258}, {obj_id:387, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:388, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:434, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187881}, {obj_id:435, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269004}, {obj_id:436, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:437, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:500, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297770}, {obj_id:686, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175750}, {obj_id:687, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189803}, {obj_id:688, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465848}, {obj_id:689, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461380}, {obj_id:690, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:352652}, {obj_id:691, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:850328}, {obj_id:692, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195368}, {obj_id:693, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276678}, {obj_id:694, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:695, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272832}, {obj_id:696, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242168}]) [2024-06-24 16:58:40.590984] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=589] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:40.593308] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=17] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13738, offset=3450516}, end_cursor:ObLogCursor{file_id=1, log_id=13739, offset=3450789}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9c9c050, len:2412, log_data_len:273, seq:13738, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:40.595602] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D90F-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219520595105000, start_id=1719219520595105000, end_id=1719219520595105001) [2024-06-24 16:58:40.596069] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8806) [2024-06-24 16:58:40.596106] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=417, avg_log_submit_to_slide_time=427) [2024-06-24 16:58:40.596601] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=36] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13739, offset=3450789}, end_cursor:ObLogCursor{file_id=1, log_id=13740, offset=3451054}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ca0050, len:2139, log_data_len:265, seq:13739, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:40.605805] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2024-06-24 16:58:40.610383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219520609882000, start_id=1719219520609882000, end_id=1719219520609882001) [2024-06-24 16:58:40.620674] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=16] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:40.621082] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=17] gc stale ls task succ [2024-06-24 16:58:40.624461] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C356-0-0] [lt=30] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219519524458, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:40.624510] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C356-0-0] [lt=46] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219519526414, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:40.624536] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C356-0-0] [lt=24] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1719213093}, renew_time:1719219519528280, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219519528275, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:40.624569] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C356-0-0] [lt=32] [LS_LOCATION]dump tenant ls location caches(tenant_id=1003, tenant_ls_locations=[{cache_key:{tenant_id:1003, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219519530101, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:40.624594] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C356-0-0] [lt=24] [LS_LOCATION]dump tenant ls location caches(tenant_id=1004, tenant_ls_locations=[{cache_key:{tenant_id:1004, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219519532027, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}, {cache_key:{tenant_id:1004, ls_id:{id:1001}, cluster_id:1719213093}, renew_time:1719219519532032, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:40.633356] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=5163) [2024-06-24 16:58:40.633393] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=5163) [2024-06-24 16:58:40.633431] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=44, avg_log_gen_to_submit_time=53, avg_log_submit_to_flush_time=387, avg_log_submit_to_slide_time=400) [2024-06-24 16:58:40.636336] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1C6-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.646240] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19F4FE-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219520645804000, start_id=1719219520645804000, end_id=1719219520645804001) [2024-06-24 16:58:40.649494] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1003, server_version={version:{val:1719219520432630000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=216858, in_cluster_service=true, cluster_version={val:1719219520350312000, v:0}, min_cluster_version={val:1719219520350312000, v:0}, max_cluster_version={val:1719219520350312000, v:0}, get_cluster_version_err=0, cluster_version_delta=299176, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59917, succ_cluster_heartbeat_count=9, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219471621660000, v:0}, local_cluster_delta=49027828, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:40.656334] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.663469] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219520662723000, start_id=1719219520662723000, end_id=1719219520662723001) [2024-06-24 16:58:40.667916] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=386, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:40.667948] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:40.667960] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:40.667978] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=451, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:40.667991] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:40.680758] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.683865] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD53-0-0] [lt=28] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:40.700078] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=30] gc stale ls task succ [2024-06-24 16:58:40.708813] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1719219520463274000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=245534, in_cluster_service=true, cluster_version={val:1719219520409442000, v:0}, min_cluster_version={val:1719219520409442000, v:0}, max_cluster_version={val:1719219520409442000, v:0}, get_cluster_version_err=0, cluster_version_delta=299366, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60206, succ_cluster_heartbeat_count=10, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219444964826000, v:0}, local_cluster_delta=75743982, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:40.724056] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] sql audit evict mem start(request_manager_->get_tenant_id()=1002, evict_low_mem_level=135291469, evict_high_mem_level=180388626, size_used=54249, mem_used=183017472) [2024-06-24 16:58:40.724804] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520724054000, start_id=1719219520724054000, end_id=1719219520724054001) [2024-06-24 16:58:40.725301] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=432, avg_log_submit_to_slide_time=446) [2024-06-24 16:58:40.730350] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=16] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:40.751527] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219520751412000, start_id=1719219520751412000, end_id=1719219520751412001) [2024-06-24 16:58:40.751605] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:40.751666] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:40.752054] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=392, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:40.752085] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=16, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:40.752112] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:40.752140] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=458, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:40.752163] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=25, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:40.753267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283402399744, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:40.756392] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.762270] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=1, elapse_time=38213, size_used=4372, mem_used=76950528) [2024-06-24 16:58:40.766028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:40.767873] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1513) [2024-06-24 16:58:40.767884] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1089) [2024-06-24 16:58:40.780819] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.786828] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=19] new mysql sessid created(conn.sessid_=3221494473, support_ssl=false) [2024-06-24 16:58:40.786911] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221494473, sess.client_addr_="172.20.17.86:49514") [2024-06-24 16:58:40.786933] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494473, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:40.787020] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494473, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:40.787055] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=31] kill and revert session(conn.sessid_=3221494473, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:40.787073] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494473, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:40.787096] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=21] mark session id unused(conn.sessid_=3221494473) [2024-06-24 16:58:40.787109] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162496][sql_nio6][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494473, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:40.788772] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1719219520788271000, start_id=1719219520788271000, end_id=1719219520788271001) [2024-06-24 16:58:40.789272] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=33, this=0x7f46f1dd4280, extra_info="") [2024-06-24 16:58:40.789294] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=21] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=411, this=0x7f46f1dd44b0, extra_info="") [2024-06-24 16:58:40.789308] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=0, this=0x7f46f1dd46e0, extra_info="") [2024-06-24 16:58:40.789318] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=9] [APPLY STAT CB EXECUTE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=-394, this=0x7f46f1dd4910, extra_info="") [2024-06-24 16:58:40.789331] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=50, this=0x7f46f1dd4b40, extra_info="") [2024-06-24 16:58:40.807257] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1FD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:40.810312] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE1FE-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:40.810513] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219520810377000, start_id=1719219520810377000, end_id=1719219520810377001) [2024-06-24 16:58:40.811097] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:40.811644] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=10] ====== check clog disk timer task ====== [2024-06-24 16:58:40.811672] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:40.811692] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=11] cannot_recycle_log_size statistics(cannot_recycle_log_size=53477054, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:40.816018] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE200-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:40.817359] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=28] LogLoopThread round_cost_time(us)(round_cost_time=15) [2024-06-24 16:58:40.819022] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE201-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:40.822020] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE202-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:40.825338] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=65] BlockGCTimerTask success(ret=0, cost_time_us=11, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):114, sequence:2}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:40.825653] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=36, mem_used=49913856) [2024-06-24 16:58:40.825680] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=16] release old cannot free more memory [2024-06-24 16:58:40.825689] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=8] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=36, size_used=0, mem_used=49913856) [2024-06-24 16:58:40.847501] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE20B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:40.849452] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219520849350000, start_id=1719219520849350000, end_id=1719219520849350001) [2024-06-24 16:58:40.849507] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=400, get_gts_with_stc_cnt=65, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:40.849554] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=8853, get_gts_with_stc_cnt=37, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=35, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:40.850522] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE20C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.855262] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE20E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:40.856448] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.856938] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=25] current monitor number(seq_=-1) [2024-06-24 16:58:40.858335] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:40.858445] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:40.858673] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:40.858743] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:40.858910] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:40.858986] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:40.859088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE210-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:40.861517] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1719219520495961000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=365552, in_cluster_service=true, cluster_version={val:1719219520348199000, v:0}, min_cluster_version={val:1719219520348199000, v:0}, max_cluster_version={val:1719219520348199000, v:0}, get_cluster_version_err=0, cluster_version_delta=513314, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60132, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219385327519000, v:0}, local_cluster_delta=135533994, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:40.862676] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219520861928000, start_id=1719219520861928000, end_id=1719219520861928001) [2024-06-24 16:58:40.871221] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE211-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:40.872939] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.873644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.873644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.873647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.873649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.873676] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.873922] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874019] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874165] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874425] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874459] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874480] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874488] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874658] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874684] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874707] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874755] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874766] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874786] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.874818] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:40.880877] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.886850] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1004, server_version={version:{val:1719219520465389002, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=421454, in_cluster_service=true, cluster_version={val:1719219520465389001, v:0}, min_cluster_version={val:1719219520465389001, v:0}, max_cluster_version={val:1719219520465389001, v:0}, get_cluster_version_err=0, cluster_version_delta=421454, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59960, succ_cluster_heartbeat_count=6, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219412155330001, v:0}, local_cluster_delta=108731513, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:40.911645] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:40.912268] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE21F-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:40.915305] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE220-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:40.924126] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:40.924859] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219520924034000, start_id=1719219520924034000, end_id=1719219520924034001) [2024-06-24 16:58:40.928823] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1586][T1003_LCLSender][T1003][Y0-0000000000000000-0-0] [lt=39] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47041fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:40.937515] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=11] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16491, offset=3757261}, end_cursor:ObLogCursor{file_id=1, log_id=16492, offset=3757534}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ca4050, len:2867, log_data_len:273, seq:16491, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:40.939636] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D900-0-0] [lt=46] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334374136924743652e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.949462451897566950e+01) [2024-06-24 16:58:40.941639] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D900-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1719219520940876000, start_id=1719219520940876000, end_id=1719219520940876001) [2024-06-24 16:58:40.941735] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D900-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8422, avg_group_log_size=601) [2024-06-24 16:58:40.941765] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D900-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8422) [2024-06-24 16:58:40.942109] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8422) [2024-06-24 16:58:40.942161] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8422) [2024-06-24 16:58:40.942201] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=426, avg_log_submit_to_slide_time=436) [2024-06-24 16:58:40.942848] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=33] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16492, offset=3757534}, end_cursor:ObLogCursor{file_id=1, log_id=16493, offset=3757799}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ca8050, len:2594, log_data_len:265, seq:16492, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:40.951609] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219520951451000, start_id=1719219520951451000, end_id=1719219520951451001) [2024-06-24 16:58:40.953768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283454828544, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:40.956504] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.956961] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2024-06-24 16:58:40.959088] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1719219520959083, bytes: 170818617, bw: 0.021555 MB/s, add_ts: 1007615, add_bytes: 22774 [2024-06-24 16:58:40.966102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:40.967668] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:40.967698] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1635, avg_group_log_size=163) [2024-06-24 16:58:40.967719] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1635) [2024-06-24 16:58:40.967736] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:40.967763] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:40.968090] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1635) [2024-06-24 16:58:40.968087] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=353, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:40.968113] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=421, avg_log_submit_to_slide_time=427) [2024-06-24 16:58:40.968389] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE234-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:40.975716] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1644) [2024-06-24 16:58:40.976933] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=17515362, clean_num=201326) [2024-06-24 16:58:40.980937] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:40.988888] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1719219520988347000, start_id=1719219520988347000, end_id=1719219520988347001) [2024-06-24 16:58:40.989498] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=29] get_max_applied_scn(scn={val:1719219520849350000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:57978623}, palf_committed_end_scn_:{val:1719219520849350001, v:0}, last_check_scn_:{val:1719219520849350001, v:0}, max_applied_cb_scn_:{val:1719219520849350000, v:0}}) [2024-06-24 16:58:40.989542] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=42] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213369678630001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:41.002952] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:41.006451] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:41.006506] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=27] get_max_applied_scn(scn={val:1719219520924034000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:53477761}, palf_committed_end_scn_:{val:1719219520924034000, v:0}, last_check_scn_:{val:1719219520924034000, v:0}, max_applied_cb_scn_:{val:1719219520924034000, v:0}}) [2024-06-24 16:58:41.006545] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:41.008904] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=104] succ to get rec scn(*this={this:0x7f47b3e04030, ls_id:{id:1}, tenant_id:1, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216858758544000, v:0}, last_push_gc_task_ts_:1719216859472314, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1025}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.008941] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47b6924080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216859475873, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47b6924080, snapshot_version:{val:1719216859475873, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.008983] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:41.009191] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:41.009314] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=118] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f47b684c1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f47b685a0d0, memtable_head:3, memtable_tail:4, t3m:0x7f47ded72030, tables:[null, null, null, 0x7f47b6914080, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215058499657, tx_data_table:0x7f47b685bb90, ls_tablet_svr:0x7f47b684c190}, min_rec_scn={val:1719216859633263000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:41.009365] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:41.009388] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219512119150001, v:0}) [2024-06-24 16:58:41.009402] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.009419] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.009440] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216859633263000, v:0}, checkpoint_scn_in_ls_meta={val:1719216859633263000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:41.009474] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:41.009498] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:41.009514] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:41.010616] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219521010519000, start_id=1719219521010519000, end_id=1719219521010519001) [2024-06-24 16:58:41.035762] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:41.035792] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:41.035828] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348796415, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:41.040689] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] tx gc loop thread is running(MTL_ID()=1) [2024-06-24 16:58:41.040707] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] try gc retain ctx [2024-06-24 16:58:41.042055] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=5] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219528711542000, latest_log_ts:{val:1719219512119150001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:41.043255] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 367.50) [2024-06-24 16:58:41.043271] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:41.043344] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 401.50) [2024-06-24 16:58:41.043355] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:41.043375] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043386] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043394] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043403] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043410] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043419] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043426] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043435] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043441] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043450] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043457] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043466] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043473] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043479] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043489] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.043499] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:41.054833] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:41.056560] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.063591] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219521063143000, start_id=1719219521063143000, end_id=1719219521063143001) [2024-06-24 16:58:41.064204] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213342229334001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:41.075383] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:41.075423] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:41.075451] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:41.075475] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:41.075739] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=308, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:41.075742] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=310, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:41.075758] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:41.075758] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:41.075779] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:41.075802] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=358, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:41.075818] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=23, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:41.075844] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:41.075858] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=374, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:41.075872] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=20, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:41.080997] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.096113] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=761, mem_used=2079744) [2024-06-24 16:58:41.096422] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.096843] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.096848] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.096863] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=52] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.096896] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.096941] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.096964] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097156] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097154] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097289] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097347] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097428] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097427] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097440] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097440] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097536] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097557] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097649] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=76] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097660] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097668] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097664] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097706] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=55] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097706] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097708] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097720] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097740] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097912] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.097923] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098024] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098024] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098074] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098204] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098342] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098422] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098585] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=54] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098608] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098640] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098664] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=57] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.098790] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.124998] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219521124439000, start_id=1719219521124439000, end_id=1719219521124439001) [2024-06-24 16:58:41.125551] INFO [LIB] stat (utility.h:1165) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=15] [APPLY STAT CB APPEND COST TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=31, this=0x7f47b68f8280, extra_info="") [2024-06-24 16:58:41.125564] INFO [LIB] stat (utility.h:1165) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=13] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=444, this=0x7f47b68f84b0, extra_info="") [2024-06-24 16:58:41.125570] INFO [LIB] stat (utility.h:1165) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=5] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=0, this=0x7f47b68f86e0, extra_info="") [2024-06-24 16:58:41.125575] INFO [LIB] stat (utility.h:1165) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=4] [APPLY STAT CB EXECUTE TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=-530, this=0x7f47b68f8910, extra_info="") [2024-06-24 16:58:41.125582] INFO [LIB] stat (utility.h:1165) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=7] [APPLY STAT CB TOTAL TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=-54, this=0x7f47b68f8b40, extra_info="") [2024-06-24 16:58:41.134134] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:41.134184] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE26D-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:41.137074] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [383][T1002_ArcSender][T1002][YB42AC141156-00061B9D8D10C0E5-0-0] [lt=29][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:41.137219] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE26E-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:41.143195] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE26F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:41.146166] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE270-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:41.149223] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE271-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:41.151755] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=59] get number(ret=0, service_type_=0, range=1, base_id=1719219521150804000, start_id=1719219521150804000, end_id=1719219521150804001) [2024-06-24 16:58:41.154561] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DD-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:41.154599] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DD-0-0] [lt=34] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:41.156276] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F8-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:41.156310] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F8-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:41.156616] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.166172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:41.167824] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:41.168181] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:41.168195] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:41.168209] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=404, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:41.168217] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:41.174866] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:41.175487] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=28] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:41.177090] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1187][T1002_TTLTablet][T1002][YB42AC141156-00061B9D9740C34D-0-0] [lt=26] finish reload tenant task(local_tenant_task_={tenant_id:1002, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:41.177392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283454828544, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:41.178060] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97B12-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:41.181055] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.182744] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27C-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:41.185504] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:41.185614] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:41.185835] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:41.185903] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:41.186071] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:41.186148] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:41.186254] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27E-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:41.188964] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=114] get number(ret=0, service_type_=0, range=1, base_id=1719219521188706000, start_id=1719219521188706000, end_id=1719219521188706001) [2024-06-24 16:58:41.198304] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE27F-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:41.201646] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=34] gc stale ls task succ [2024-06-24 16:58:41.211067] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=62] submit log success(service_type_=0, last_id=1719219537830421000, limited_id=1719219537830421000) [2024-06-24 16:58:41.211094] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] submit log with lock success(service_type_=0, last_id=1719219537830421000, limited_id=1719219537830421000) [2024-06-24 16:58:41.211111] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219521210793000, start_id=1719219521210793000, end_id=1719219521210793001) [2024-06-24 16:58:41.211462] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1719219537830421000, latest_scn={val:1719219521210793001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:41.211535] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=72] handle submit callback(service_type_=0, success=true, used_ts=470, log_ts={val:1719219521210793001, v:0}, limited_id=1719219537830421000) [2024-06-24 16:58:41.211553] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:41.211567] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:41.211785] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219521210793000, start_id=1719219521210793001, end_id=1719219521210793002) [2024-06-24 16:58:41.211806] INFO [STORAGE.TRANS] wait_gts_elapse (ob_gts_source.cpp:434) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] wait queue push task success(task=0x7f47646268f0) [2024-06-24 16:58:41.211846] INFO [STORAGE.TRANS] wait_gts_elapse_commit_version_ (ob_trans_part_ctx.cpp:2846) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] need wait gts elapse(ret=0, ret="OB_SUCCESS", *this={this:0x7f4764625450, ref:3, trans_id:{txid:81260}, tenant_id:1001, is_exiting:false, trans_expired_time:1719219551210780, cluster_version:17180066048, trans_need_wait_wrap:{receive_gts_ts_:[mts=0], need_wait_interval_us:0}, stc:[mts=1719219521211024], ctx_create_time:1719219521210793}{ls_id:{id:1}, session_id:1, part_trans_action:3, pending_write:0, exec_info:state:20, upstream:{id:-1}, participants:[{id:1}], incremental_participants:[], intermediate_participants:[], prev_record_lsn:{lsn:18446744073709551615}, redo_lsns:[], redo_log_no:0, multi_data_source:[], scheduler:"172.20.17.86:2882", prepare_version:{val:18446744073709551615, v:3}, trans_type:0, next_log_entry_no:1, max_applied_log_ts:{val:1719219521210793002, v:0}, max_applying_log_ts:{val:1719219521210793002, v:0}, max_applying_part_log_no:0, max_submitted_seq_no:{branch:0, seq:3}, checksum:[0], checksum_scn:[{val:0, v:0}], max_durable_lsn:{lsn:70320421}, data_complete:false, is_dup_tx:false, prepare_log_info_arr:[], xid:{gtrid_str:"", bqual_str:"", format_id:1, gtrid_str_.ptr():"data_size:0, data:", bqual_str_.ptr():"data_size:0, data:", g_hv:0, b_hv:0}, need_checksum:true, is_sub2pc:false, is_transfer_blocking:false, commit_parts:[{ls_id:{id:1}, exec_epoch:533313415608010, transfer_epoch:-1}], transfer_parts:[], is_empty_ctx_created_by_transfer:false, exec_epoch:0, serial_final_scn:{val:18446744073709551615, v:3}, serial_final_seq_no:0, dli_batch_set:, sub_state:{flag:22}, is_leaf():false, is_root():false, busy_cbs_.get_size():1, final_log_cb_:{ObTxBaseLogCb:{base_ts:{val:1719219521210793000, v:0}, log_ts:{val:1719219521210793002, v:0}, lsn:{lsn:70320421}, submit_ts:1719219521211153}, this:0x7f4764628d78, is_inited_:true, trans_id:{txid:81260}, ls_id:{id:1}, ctx:0x7f4764625450, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, ctx_tx_data_:{ctx_mgr_:0x7f4753204030, tx_data_guard_:{tx_data:{tx_id:{txid:81260}, ref_cnt:1, state:"ELR_COMMIT", commit_version:{val:1719219521210793002, v:0}, start_scn:{val:1719219521210793002, v:0}, end_scn:{val:1719219521210793002, v:0}, undo_status_list:{head:null, undo_node_cnt:0{}}}}, read_only_:false}, role_state_:0, create_ctx_scn_:{val:18446744073709551615, v:3}, ctx_source:1, epoch_:533313415608010, replay_completeness_:1, mt_ctx_:{ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213329638848 max_table_version=1719213329638848 trans_version={val:1719219521210793000, v:0} commit_version={val:1719219521210793002, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:81260} ls_id=1 row_callback[alloc:1, free:0, unsubmit:0] redo[fill:2,sync_succ:2, sync_fail:0] main_list_len=2 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,2,2,2,2,0,0,0)|]}}, coord_prepare_info_arr_:[], upstream_state:10, retain_cause:-1, 2pc_role:-1, collected:[], rec_log_ts:{val:1719219521210793002, v:0}, prev_rec_log_ts:{val:18446744073709551615, v:3}, lastest_snapshot:{val:18446744073709551615, v:3}, state_info_array:[], last_request_ts:1719219521210793, block_frozen_memtable:null, max_2pc_commit_scn:{val:18446744073709551615, v:3}}) [2024-06-24 16:58:41.238515] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE28C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:41.240819] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:41.240844] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:41.241230] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:41.241243] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=423, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:41.241250] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=25, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:41.241520] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE28D-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:41.256676] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.263683] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=105] get number(ret=0, service_type_=0, range=1, base_id=1719219521263442000, start_id=1719219521263442000, end_id=1719219521263442001) [2024-06-24 16:58:41.281115] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.291289] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:103515, max_lsn:517675055, max_scn:{val:1719219520849350004, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:517675055}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:475732015}}, last_submit_lsn:{lsn:517674933}, last_submit_end_lsn:{lsn:517675055}, last_submit_log_id:103515, last_submit_log_pid:1, max_flushed_lsn:{lsn:517674933}, max_flushed_end_lsn:{lsn:517675055}, max_flushed_log_pid:1, committed_end_lsn:{lsn:517675055}, last_slide_log_id:103515, last_slide_scn:{val:1719219520849350004, v:0}, last_slide_lsn:{lsn:517674933}, last_slide_end_lsn:{lsn:517675055}, last_slide_log_pid:1, last_slide_log_accum_checksum:3586330032, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4736730530}, [StateMgr]={this:0x7f47367342b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:103516, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213349729967, palf_role_change_cb:0x7f473673acb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4736731c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213342229334002, v:0}, base_lsn_for_block_gc:{lsn:201314304}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:201314304}, prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}}, log_meta_storage:{log_tail:{lsn:24576}, readable_log_tail:{lsn:24576}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:536838144}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1001/meta", dir_fd:674, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67080192, block_header_serialize_buf_:0x7f4736736478, flashback_version:0}, log_storage:{log_tail:{lsn:517675055}, readable_log_tail:{lsn:517675055}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:469733376}, min_scn:{val:1719215616323502002, v:0}, curr_block_id:7, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1001/log", dir_fd:675, min_block_id:0, max_block_id:8, curr_writable_block_id:7}, logical_block_size_:67104768, curr_block_writable_size_:19163089, block_header_serialize_buf_:0x7f4736738138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213349730110, this:0x7f47367349f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213349730486, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4736734430}) [2024-06-24 16:58:41.292068] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=773] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219521275958, last_flushed_end_lsn:{lsn:517675055}}]) [2024-06-24 16:58:41.292096] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=103516, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219521275958, last_flushed_end_lsn:{lsn:517675055}}]) [2024-06-24 16:58:41.294579] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2A2-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:41.301049] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:41.301077] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:41.301106] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=70321543, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:41.307610] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=7] ====== checkpoint timer task ====== [2024-06-24 16:58:41.308897] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=31] succ to get rec scn(*this={this:0x7f474be04030, ls_id:{id:1}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215719054755000, v:0}, last_push_gc_task_ts_:1719216936767864, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.308925] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739404080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216936773978, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739404080, snapshot_version:{val:1719216936773978, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.308952] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:41.309043] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219518343936002, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:41.309114] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f4753c761b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f4753c840d0, memtable_head:2, memtable_tail:3, t3m:0x7f4782d1e030, tables:[null, null, 0x7f4753dced90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215135780086, tx_data_table:0x7f4753c85b90, ls_tablet_svr:0x7f4753c76190}, min_rec_scn={val:1719216939041208000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:41.309144] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:41.309157] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=0, rec_log_ts={val:1719219519847687001, v:0}) [2024-06-24 16:58:41.309144] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A9-0-0] [lt=51][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:41.309167] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=10] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.309168] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8A9-0-0] [lt=22][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:41.309179] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=6] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216939041208000, v:0}, checkpoint_scn_in_ls_meta={val:1719216939041208000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:41.309194] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:41.309209] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:41.310470] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=7] succ to get rec scn(*this={this:0x7f474beb6030, ls_id:{id:1001}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213748817809002, v:0}, last_push_gc_task_ts_:1719215150704743, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:580}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.310488] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739405350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215150709832, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739405350, snapshot_version:{val:1719215150709832, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:41.310508] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:41.310548] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219518343936002, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:41.310611] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=61] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f4736709790}, min_rec_scn={val:1719215150797158000, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:41.310644] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213342229334001, v:0}) [2024-06-24 16:58:41.310658] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215150797158000, v:0}, checkpoint_scn_in_ls_meta={val:1719215150797158000, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:41.310671] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:201314304}, new_base_lsn={lsn:201314304}, lsn={lsn:201314304}) [2024-06-24 16:58:41.310683] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:201314304}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:41.310691] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=7] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:41.325143] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219521324612000, start_id=1719219521324612000, end_id=1719219521324612001) [2024-06-24 16:58:41.325226] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3825, avg_group_log_size=425) [2024-06-24 16:58:41.325216] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=37] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:41.325256] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3825) [2024-06-24 16:58:41.325596] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4410) [2024-06-24 16:58:41.325663] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4410) [2024-06-24 16:58:41.326243] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=111953, mem_used=264127488) [2024-06-24 16:58:41.326791] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:41.328450] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [1354][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1004, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:41.328572] WDIAG read_multi_row (ob_table_access_helper.h:238) [1354][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=36][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1004, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:41.328762] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:221) [1354][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=21] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:41.333513] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19F50B-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219521333039000, start_id=1719219521333039000, end_id=1719219521333039001) [2024-06-24 16:58:41.333781] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5755-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219521333039000, start_id=1719219521333039001, end_id=1719219521333039002) [2024-06-24 16:58:41.335192] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:41.335316] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=123] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:41.335337] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:41.335412] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=75] get_replay_process success(id={id:1001}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:41.335471] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=14] dump tenant replay process(tenant_id=1004, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:41.343093] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=32] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:41.350342] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219521349880000, start_id=1719219521349880000, end_id=1719219521349880001) [2024-06-24 16:58:41.350383] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:41.350843] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219521350824], gts:1719219521349880000, latest_srr:[mts=1719219521350824]}) [2024-06-24 16:58:41.351916] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219521350937000, start_id=1719219521350937000, end_id=1719219521350937001) [2024-06-24 16:58:41.356731] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.366245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:41.367959] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:41.367995] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:41.375574] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1644, avg_group_log_size=164) [2024-06-24 16:58:41.375608] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1644) [2024-06-24 16:58:41.375958] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1644) [2024-06-24 16:58:41.378493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283456925696, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:41.381173] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.389096] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219521388928000, start_id=1719219521388928000, end_id=1719219521388928001) [2024-06-24 16:58:41.402287] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:231) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=16] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"8GB", log_disk_size:"24GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}, {unit:unit_id:1002, resource_pool_id:1002, unit_group_id:1002, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"16GB", log_disk_size:"48GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1002, name:"ocp_monitor_pool", unit_count:1, unit_config_id:1002, zone_list:["zone1"], tenant_id:1004, replica_type:0}}]) [2024-06-24 16:58:41.402397] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:810) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=104] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2024-06-24 16:58:41.402416] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:705) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=16] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, user_resource={min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, unit_resource={min_cpu:4, max_cpu:4, memory_size:"8GB", log_disk_size:"24GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}) [2024-06-24 16:58:41.402451] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:125) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=32] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}) [2024-06-24 16:58:41.402495] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:810) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=40] jx_debug: get tenant compatibility mode(tenant_id=1004, compat_mode=0) [2024-06-24 16:58:41.402508] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:705) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=13] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, user_resource={min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, unit_resource={min_cpu:4, max_cpu:4, memory_size:"16GB", log_disk_size:"48GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}) [2024-06-24 16:58:41.402534] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:125) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=26] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}, user_config={tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}) [2024-06-24 16:58:41.406453] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=33] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2024-06-24 16:58:41.408551] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=30] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2024-06-24 16:58:41.410548] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=30] refresh_resource_function_mapping_rule(tenant_id=1, plan=, rules=[]) [2024-06-24 16:58:41.410579] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=29] refresh resource mapping rule success(tenant_id=1, plan=) [2024-06-24 16:58:41.411149] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219521411127000, start_id=1719219521411127000, end_id=1719219521411127001) [2024-06-24 16:58:41.411227] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:41.411262] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:41.411651] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=728, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:41.411685] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:41.411713] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:41.411744] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=799, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:41.411761] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=22, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:41.412500] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C355-0-0] [lt=17] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:41.412683] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C355-0-0] [lt=27] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:41.412706] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C355-0-0] [lt=20] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:41.416233] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=21] refresh resource plan success(tenant_id=1001, plan_name=, directives=[]) [2024-06-24 16:58:41.418278] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=26] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2024-06-24 16:58:41.420169] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=27] refresh_resource_function_mapping_rule(tenant_id=1001, plan=, rules=[]) [2024-06-24 16:58:41.420198] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=27] refresh resource mapping rule success(tenant_id=1001, plan=) [2024-06-24 16:58:41.420675] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129747, mem_used=326519808) [2024-06-24 16:58:41.421952] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C355-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2024-06-24 16:58:41.422135] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C355-0-0] [lt=27] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:41.422155] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C355-0-0] [lt=18] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:41.425339] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=13] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:41.425367] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=13] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1234) [2024-06-24 16:58:41.425840] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=20] refresh resource plan success(tenant_id=1002, plan_name=, directives=[]) [2024-06-24 16:58:41.427835] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=26] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2024-06-24 16:58:41.429718] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=26] refresh_resource_function_mapping_rule(tenant_id=1002, plan=, rules=[]) [2024-06-24 16:58:41.429746] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=27] refresh resource mapping rule success(tenant_id=1002, plan=) [2024-06-24 16:58:41.431543] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C355-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:41.431757] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C355-0-0] [lt=27] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:41.431778] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C355-0-0] [lt=19] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:41.433217] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C355-0-0] [lt=19][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1690, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:41.435045] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=25] refresh resource plan success(tenant_id=1003, plan_name=, directives=[]) [2024-06-24 16:58:41.436809] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=22] refresh resource user mapping rule(tenant_id=1003, plan=, user_rules=[]) [2024-06-24 16:58:41.437044] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [967][T1001_ArcSender][T1001][YB42AC141156-00061B9D8DB0C0E5-0-0] [lt=38][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:41.438490] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=24] refresh_resource_function_mapping_rule(tenant_id=1003, plan=, rules=[]) [2024-06-24 16:58:41.438517] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=25] refresh resource mapping rule success(tenant_id=1003, plan=) [2024-06-24 16:58:41.440112] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C355-0-0] [lt=13] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2024-06-24 16:58:41.440289] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C355-0-0] [lt=24] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:41.440307] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C355-0-0] [lt=16] tenant dfc status(ret=0, get_tenant_id()=1003, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:41.443605] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=18] refresh resource plan success(tenant_id=1004, plan_name=, directives=[]) [2024-06-24 16:58:41.445337] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=36] refresh resource user mapping rule(tenant_id=1004, plan=, user_rules=[]) [2024-06-24 16:58:41.447036] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=26] refresh_resource_function_mapping_rule(tenant_id=1004, plan=, rules=[]) [2024-06-24 16:58:41.447062] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=24] refresh resource mapping rule success(tenant_id=1004, plan=) [2024-06-24 16:58:41.448846] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C355-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:41.449005] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C355-0-0] [lt=25] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:41.449024] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C355-0-0] [lt=17] tenant dfc status(ret=0, get_tenant_id()=1004, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:41.449059] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:108) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=17] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, {tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, {tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}], ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:41.449137] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=71] finish set nway(tenant_id_=1, nway=4) [2024-06-24 16:58:41.449151] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=13] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=4, new_tma_limit=1073741800, pre_tma_limit=1073741800, cur_memstore_limit_percent=50, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}) [2024-06-24 16:58:41.449179] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C355-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.740799999237060547e+03, this=0x7f47dedb4170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=8703, Resource Limit(MB)=8703, Throttle Trigger(MB)=5222, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=3.132550312791559585e-03) [2024-06-24 16:58:41.449206] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C355-0-0] [lt=26] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2024-06-24 16:58:41.449222] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=10] finish set nway(tenant_id_=1002, nway=4) [2024-06-24 16:58:41.449232] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=4, new_tma_limit=4509715620, pre_tma_limit=4509715620, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}) [2024-06-24 16:58:41.449255] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C355-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=5.734399948120117188e+02, this=0x7f4782dd6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2867, Resource Limit(MB)=2867, Throttle Trigger(MB)=1720, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=2.654160334594075632e-01) [2024-06-24 16:58:41.449275] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C355-0-0] [lt=20] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2024-06-24 16:58:41.449290] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] finish set nway(tenant_id_=1001, nway=1) [2024-06-24 16:58:41.449300] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}) [2024-06-24 16:58:41.449321] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C355-0-0] [lt=19] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f4764fea170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2024-06-24 16:58:41.449342] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C355-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2024-06-24 16:58:41.449356] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] finish set nway(tenant_id_=1004, nway=4) [2024-06-24 16:58:41.449365] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1004, nway=4, new_tma_limit=7730941100, pre_tma_limit=7730941100, cur_memstore_limit_percent=50, tenant_config={tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}) [2024-06-24 16:58:41.449388] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C355-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.474559993743896484e+03, this=0x7f47285d6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=7372, Resource Limit(MB)=7372, Throttle Trigger(MB)=4423, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.083503486695933209e-03) [2024-06-24 16:58:41.449406] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C355-0-0] [lt=18] succ to set_memstore_threshold of memstore allocator(tenant_id=1004, ret=0) [2024-06-24 16:58:41.449420] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] finish set nway(tenant_id_=1003, nway=1) [2024-06-24 16:58:41.449429] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1003, nway=1, new_tma_limit=1030792140, pre_tma_limit=1030792140, cur_memstore_limit_percent=40, tenant_config={tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}) [2024-06-24 16:58:41.449450] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C355-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.310719985961914062e+02, this=0x7f4703dde170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=655, Resource Limit(MB)=655, Throttle Trigger(MB)=393, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=9.610614047311770491e+01) [2024-06-24 16:58:41.449470] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C355-0-0] [lt=20] succ to set_memstore_threshold of memstore allocator(tenant_id=1003, ret=0) [2024-06-24 16:58:41.451096] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=7] cal_all_part_disk_default_percentage succ(data_dir="/data/1/sstable", clog_dir="/data/1/clog", shared_mode=true, data_disk_total_size=2396821651456, data_disk_default_percentage=60, clog_disk_total_size=2396821651456, clog_disk_default_percentage=30) [2024-06-24 16:58:41.451126] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=28] decide disk size finished(suggested_disk_size=804232626176, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2396821651456, disk_size=804232626176) [2024-06-24 16:58:41.451143] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=16] get_log_disk_info_in_config(suggested_data_disk_size=890131972096, suggested_clog_disk_size=804232626176, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=804232626176, log_disk_percentage=0, total_log_disk_size=2396821651456) [2024-06-24 16:58:41.451161] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:785) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=14] try_resize success(ret=0, log_disk_size=804232626176, total_log_disk_size=2396821651456, this={dir::"/data/1/clog/log_pool", dir_fd:14, meta_fd:15, log_pool_meta:{curr_total_size:804232626176, next_total_size:804232626176, status:0}, min_block_id:23, max_block_id:11984, min_log_disk_size_for_all_tenants_:95563022336, is_inited:true}) [2024-06-24 16:58:41.451185] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:132) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C355-0-0] [lt=23] refresh tenant config(tenants=[1, 1001, 1002, 1003, 1004], ret=0) [2024-06-24 16:58:41.456790] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.463078] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2DD-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:41.463826] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219521462796000, start_id=1719219521462796000, end_id=1719219521462796001) [2024-06-24 16:58:41.464430] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219520849350004, v:0}, new_max_version={val:1719219520849350004, v:0}, last_min_version={val:1719219520849350001, v:0}, last_max_version={val:1719219520849350001, v:0}, total_time_us=2541, delta_us=615079) [2024-06-24 16:58:41.464468] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219520849350004, v:0}, min_version={val:1719219520849350004, v:0}, max_version={val:1719219520849350004, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:41.466192] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2DE-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:41.471929] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2E0-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:41.474931] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2E1-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:41.475675] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=5334, avg_group_log_size=355) [2024-06-24 16:58:41.475710] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=5334) [2024-06-24 16:58:41.476022] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=13, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=682, avg_log_submit_to_slide_time=689) [2024-06-24 16:58:41.478029] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2E2-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:41.481138] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:41.481232] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.490349] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [162824][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:41.502891] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EA-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:41.505906] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:41.510551] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2ED-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:41.513398] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:41.513510] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:41.513746] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:41.513816] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:41.513985] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:41.514062] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:41.514166] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2EF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:41.525289] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219521525086000, start_id=1719219521525086000, end_id=1719219521525086001) [2024-06-24 16:58:41.525763] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=367, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:41.525796] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:41.526372] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2F0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4565, pos=3045, bitmap=NULL) [2024-06-24 16:58:41.531055] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=7] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2024-06-24 16:58:41.531086] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=27] start lib cache evict(tenant_id=1002, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:41.531104] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:41.531121] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:41.538719] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:41.538186] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=11] Dumping All Cache Objs(alloc_obj_list.count()=753, alloc_obj_list=[{obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:206, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:208, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:213, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:215, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:218, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:219, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:221, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:222, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:223, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:224, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:225, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:226, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:227, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:230, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:258, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:259, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207636}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157087}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:262, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417132}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:293, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:297, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178532}, {obj_id:299, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174372}, {obj_id:311, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:312, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:313, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:314, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:315, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:316, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:317, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:318, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:319, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:320, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:370, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:371, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:372, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:373, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:374, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:375, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:376, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:377, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:378, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:394, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217236}, {obj_id:404, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:405, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:431, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200789}, {obj_id:787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:1554, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174647}, {obj_id:1765, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196131}, {obj_id:1767, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180746}, {obj_id:1768, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180053}, {obj_id:1769, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156392}, {obj_id:1770, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185682}, {obj_id:1771, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178754}, {obj_id:1772, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217927}, {obj_id:1773, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182452}, {obj_id:1774, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157145}, {obj_id:1775, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193250}, {obj_id:1776, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156261}, {obj_id:1777, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202011}, {obj_id:1778, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176126}, {obj_id:1779, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:1780, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179533}, {obj_id:1782, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194286}, {obj_id:1783, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191084}, {obj_id:1784, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185716}, {obj_id:1785, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197901}, {obj_id:1786, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203431}, {obj_id:1787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177702}, {obj_id:1788, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197376}, {obj_id:1789, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194100}, {obj_id:1790, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229422}, {obj_id:1791, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342799}, {obj_id:1792, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177856}, {obj_id:1793, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:1794, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:1801, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197017}, {obj_id:1802, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197375}, {obj_id:1803, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192944}, {obj_id:1804, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210981}, {obj_id:1807, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1808, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191543}, {obj_id:1809, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190396}, {obj_id:1810, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179961}, {obj_id:1811, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187508}, {obj_id:1812, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190770}, {obj_id:1814, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174667}, {obj_id:1817, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186991}, {obj_id:1820, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181584}, {obj_id:1822, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201206}, {obj_id:1823, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187930}, {obj_id:1824, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182810}, {obj_id:1826, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205149}, {obj_id:1828, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181586}, {obj_id:1830, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184827}, {obj_id:1832, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173928}, {obj_id:1833, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241466}, {obj_id:1834, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173654}, {obj_id:1835, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174122}, {obj_id:1841, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183277}, {obj_id:1842, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202767}, {obj_id:1843, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184717}, {obj_id:1844, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179338}, {obj_id:1845, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192322}, {obj_id:1846, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186117}, {obj_id:1847, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:243066}, {obj_id:1850, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203203}, {obj_id:1851, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206987}, {obj_id:1854, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202239}, {obj_id:1857, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179623}, {obj_id:1858, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199630}, {obj_id:1859, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181089}, {obj_id:1860, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191144}, {obj_id:1861, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208300}, {obj_id:1862, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207006}, {obj_id:1864, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174459}, {obj_id:1865, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197772}, {obj_id:1866, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195985}, {obj_id:1867, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187545}, {obj_id:1868, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200975}, {obj_id:1869, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190129}, {obj_id:1870, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187648}, {obj_id:1871, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180383}, {obj_id:1872, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176694}, {obj_id:1873, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199714}, {obj_id:1874, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197401}, {obj_id:1875, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211269}, {obj_id:1878, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197823}, {obj_id:1879, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180556}, {obj_id:1880, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186838}, {obj_id:1881, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173640}, {obj_id:1882, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189084}, {obj_id:1883, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182778}, {obj_id:1884, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198543}, {obj_id:1885, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184808}, {obj_id:1886, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192715}, {obj_id:1887, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178511}, {obj_id:1889, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:1890, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190883}, {obj_id:1892, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204317}, {obj_id:1895, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200704}, {obj_id:1897, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180059}, {obj_id:1898, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189670}, {obj_id:1899, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297520}, {obj_id:1900, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180210}, {obj_id:1901, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173929}, {obj_id:1902, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207174}, {obj_id:1904, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180315}, {obj_id:1905, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175944}, {obj_id:1906, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191394}, {obj_id:1907, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205016}, {obj_id:1908, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205015}, {obj_id:1909, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205042}, {obj_id:1910, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183144}, {obj_id:1912, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156278}, {obj_id:1914, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201207}, {obj_id:1915, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205705}, {obj_id:1916, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179043}, {obj_id:1918, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210554}, {obj_id:1919, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211414}, {obj_id:1920, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203461}, {obj_id:1922, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179984}, {obj_id:1924, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194777}, {obj_id:1926, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212517}, {obj_id:1927, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185341}, {obj_id:1928, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211233}, {obj_id:1929, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180552}, {obj_id:1930, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199580}, {obj_id:1932, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200277}, {obj_id:1933, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202039}, {obj_id:1935, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202217}, {obj_id:1938, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:1939, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185428}, {obj_id:1940, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342648}, {obj_id:1941, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184408}, {obj_id:1942, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188029}, {obj_id:1943, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220581}, {obj_id:1944, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186138}, {obj_id:1945, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188109}, {obj_id:1946, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184071}, {obj_id:1947, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297497}, {obj_id:1948, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259587}, {obj_id:1949, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234741}, {obj_id:1950, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230127}, {obj_id:1951, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:1952, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199425}, {obj_id:1953, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204260}, {obj_id:1955, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186747}, {obj_id:1956, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186410}, {obj_id:1957, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180371}, {obj_id:1959, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186746}, {obj_id:1960, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:314579}, {obj_id:1961, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316276}, {obj_id:1962, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179253}, {obj_id:1963, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198957}, {obj_id:1964, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253315}, {obj_id:1965, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194531}, {obj_id:1966, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181919}, {obj_id:1968, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204268}, {obj_id:1969, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:1970, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156216}, {obj_id:1971, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:1973, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206972}, {obj_id:1974, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372622}, {obj_id:1975, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:1976, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:1977, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255312}, {obj_id:1978, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255070}, {obj_id:1979, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281856}, {obj_id:1980, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312870}, {obj_id:1982, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:1983, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210959}, {obj_id:1984, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:1986, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216413}, {obj_id:1987, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:1988, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207457}, {obj_id:1989, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197063}, {obj_id:1990, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202377}, {obj_id:1991, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319848}, {obj_id:1993, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177048}, {obj_id:1994, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179527}, {obj_id:1996, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:390465}, {obj_id:1997, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181650}, {obj_id:1998, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180128}, {obj_id:1999, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175288}, {obj_id:2000, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179784}, {obj_id:2001, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183026}, {obj_id:2002, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179032}, {obj_id:2003, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186850}, {obj_id:2004, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207791}, {obj_id:2005, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188599}, {obj_id:2006, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241706}, {obj_id:2007, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179781}, {obj_id:2008, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189180}, {obj_id:2010, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175346}, {obj_id:2011, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182950}, {obj_id:2012, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178932}, {obj_id:2013, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184319}, {obj_id:2014, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182003}, {obj_id:2015, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:383980}, {obj_id:2016, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175770}, {obj_id:2017, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180015}, {obj_id:2018, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219419}, {obj_id:2019, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204596}, {obj_id:2020, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181397}, {obj_id:2021, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179054}, {obj_id:2022, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156256}, {obj_id:2023, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237344}, {obj_id:2024, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209999}, {obj_id:2025, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230256}, {obj_id:2026, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188496}, {obj_id:2027, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179278}, {obj_id:2028, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192304}, {obj_id:2029, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195605}, {obj_id:2030, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183563}, {obj_id:2031, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182637}, {obj_id:2033, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:392174}, {obj_id:2035, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304600}, {obj_id:2037, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184788}, {obj_id:2038, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185565}, {obj_id:2039, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181321}, {obj_id:2040, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204506}, {obj_id:2041, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:348902}, {obj_id:2042, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222494}, {obj_id:2043, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220331}, {obj_id:2044, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181427}, {obj_id:2045, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226680}, {obj_id:2046, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192432}, {obj_id:2047, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225643}, {obj_id:2048, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174740}, {obj_id:2049, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215812}, {obj_id:2050, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196675}, {obj_id:2051, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179861}, {obj_id:2052, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204953}, {obj_id:2053, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196998}, {obj_id:2054, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179552}, {obj_id:2055, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197192}, {obj_id:2056, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187268}, {obj_id:2057, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185914}, {obj_id:2058, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205463}, {obj_id:2059, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:391976}, {obj_id:2060, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202155}, {obj_id:2061, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207183}, {obj_id:2062, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228354}, {obj_id:2063, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240497}, {obj_id:2064, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182911}, {obj_id:2065, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218028}, {obj_id:2066, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210463}, {obj_id:2067, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176755}, {obj_id:2068, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2069, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198027}, {obj_id:2070, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181248}, {obj_id:2071, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179856}, {obj_id:2072, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185425}, {obj_id:2073, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:365208}, {obj_id:2074, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189692}, {obj_id:2075, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183454}, {obj_id:2076, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238844}, {obj_id:2077, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321800}, {obj_id:2078, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186250}, {obj_id:2079, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196079}, {obj_id:2080, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332305}, {obj_id:2081, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320208}, {obj_id:2082, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251367}, {obj_id:2083, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182508}, {obj_id:2084, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300805}, {obj_id:2085, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178980}, {obj_id:2086, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178916}, {obj_id:2087, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209270}, {obj_id:2088, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184260}, {obj_id:2089, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183375}, {obj_id:2090, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240830}, {obj_id:2091, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201771}, {obj_id:2092, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192848}, {obj_id:2093, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185409}, {obj_id:2094, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185960}, {obj_id:2095, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178833}, {obj_id:2096, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184221}, {obj_id:2098, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186713}, {obj_id:2099, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215730}, {obj_id:2101, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197347}, {obj_id:2102, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193779}, {obj_id:2103, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234706}, {obj_id:2104, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179916}, {obj_id:2105, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204599}, {obj_id:2106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208576}, {obj_id:2107, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196385}, {obj_id:2108, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2109, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2110, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181778}, {obj_id:2114, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210988}, {obj_id:2115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209186}, {obj_id:2116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197363}, {obj_id:2117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223906}, {obj_id:2118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201491}, {obj_id:2119, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292238}, {obj_id:2120, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207205}, {obj_id:2122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226896}, {obj_id:2123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181523}, {obj_id:2124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213117}, {obj_id:2125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:2126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179447}, {obj_id:2127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183182}, {obj_id:2128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184816}, {obj_id:2129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200736}, {obj_id:2130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224430}, {obj_id:2132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207161}, {obj_id:2133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192675}, {obj_id:2135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385804}, {obj_id:2137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230239}, {obj_id:2153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202184}, {obj_id:2156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205408}, {obj_id:2157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206436}, {obj_id:2158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174583}, {obj_id:2162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213869}, {obj_id:2163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195408}, {obj_id:2164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203912}, {obj_id:2166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182577}, {obj_id:2167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181498}, {obj_id:2168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199791}, {obj_id:2169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184951}, {obj_id:2170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265434}, {obj_id:2171, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186761}, {obj_id:2172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180107}, {obj_id:2173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205227}, {obj_id:2174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210318}, {obj_id:2175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196533}, {obj_id:2176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180448}, {obj_id:2177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185110}, {obj_id:2178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191697}, {obj_id:2179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217620}, {obj_id:2180, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221861}, {obj_id:2181, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185962}, {obj_id:2182, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:422104}, {obj_id:2183, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190931}, {obj_id:2184, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192945}, {obj_id:2185, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179350}, {obj_id:2186, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:2187, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188846}, {obj_id:2188, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417908}, {obj_id:2189, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180199}, {obj_id:2195, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207911}, {obj_id:2203, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188121}, {obj_id:2204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196915}, {obj_id:2205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385249}, {obj_id:2209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2211, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem [2024-06-24 16:58:41.540098] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=1908] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:41.540370] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=26] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:41.540574] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:41.540703] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516701057000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:41.552056] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219521551501000, start_id=1719219521551501000, end_id=1719219521551501001) [2024-06-24 16:58:41.556849] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.558677] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC10-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103417650044, cache_obj->added_lc()=false, cache_obj->get_object_id()=9363, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:41.566320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:41.566585] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE2FF-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:41.568435] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:41.568486] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=666, avg_log_submit_to_slide_time=673) [2024-06-24 16:58:41.569572] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE300-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:41.570679] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8388, avg_group_log_size=493) [2024-06-24 16:58:41.570720] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8388) [2024-06-24 16:58:41.571033] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8388) [2024-06-24 16:58:41.579017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283454828544, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:41.581291] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.588794] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219521588492000, start_id=1719219521588492000, end_id=1719219521588492001) [2024-06-24 16:58:41.591818] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=20] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:41.591940] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=121] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:41.592005] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=18] dump tenant replay process(tenant_id=1003, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:41.592452] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] [COMPACTION DAG STATUS] (start_time=1719219511590647, end_time=1719219521592447, dag_status={}) [2024-06-24 16:58:41.592489] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592512] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592531] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592572] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592606] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592620] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:41.592651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592689] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592725] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592759] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592775] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592809] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592858] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592874] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592890] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592906] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592923] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592939] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592956] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.592991] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593007] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593023] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593056] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593076] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593093] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593109] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593128] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593194] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593210] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593227] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593266] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593283] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593299] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593316] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593332] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593348] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593380] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593399] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593431] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593485] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593501] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593517] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593536] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593552] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593569] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593585] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593601] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:41.593640] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:41.593651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:41.593665] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:41.593679] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:41.593696] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:41.593709] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:41.593720] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:41.593730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:41.593741] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:41.593753] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:41.593764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:41.596353] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1719219521596349, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-06-24 16:58:41.599722] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13740, offset=3451054}, end_cursor:ObLogCursor{file_id=1, log_id=13741, offset=3451327}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cac050, len:1874, log_data_len:273, seq:13740, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:41.600222] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:227) [162289][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=34] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=0) [2024-06-24 16:58:41.602098] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D910-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219521601181000, start_id=1719219521601181000, end_id=1719219521601181001) [2024-06-24 16:58:41.602524] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8388) [2024-06-24 16:58:41.602554] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=20, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=784, avg_log_submit_to_slide_time=795) [2024-06-24 16:58:41.603090] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=36] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13741, offset=3451327}, end_cursor:ObLogCursor{file_id=1, log_id=13742, offset=3451592}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cb0050, len:1601, log_data_len:265, seq:13741, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:41.609309] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1719219521411127000, v:0}, base_version={val:1719219521210793002, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219521411127000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219521609294, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:41.611292] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219521610693000, start_id=1719219521610693000, end_id=1719219521610693001) [2024-06-24 16:58:41.620779] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=16] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:41.621143] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:41.623431] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE311-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:41.650293] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19F521-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219521649772000, start_id=1719219521649772000, end_id=1719219521649772001) [2024-06-24 16:58:41.650686] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4689) [2024-06-24 16:58:41.650718] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=4689) [2024-06-24 16:58:41.650744] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=363, avg_log_submit_to_slide_time=372) [2024-06-24 16:58:41.656908] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.663943] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219521663517000, start_id=1719219521663517000, end_id=1719219521663517001) [2024-06-24 16:58:41.664078] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169721-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219521663517000, start_id=1719219521663517000, end_id=1719219521663517001) [2024-06-24 16:58:41.668534] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=653, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:41.668563] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:41.668577] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:41.668602] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=714, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:41.668618] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:41.681354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.691089] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1353][T1004_LockWaitM][T1004][Y0-0000000000000000-0-0] [lt=18] report RowHolderMapper summary info(count=2620, bkt_cnt=7838) [2024-06-24 16:58:41.700140] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:41.720921] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [1593][T1003_ObXAHbWor][T1003][Y0-0000000000000000-0-0] [lt=24] XA scheduler heartbeat task statistics(avg_time=3) [2024-06-24 16:58:41.722596] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:41.722639] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:41.722683] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=28] cannot_recycle_log_size statistics(cannot_recycle_log_size=103059263, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:41.724802] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2024-06-24 16:58:41.725391] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219521724862000, start_id=1719219521724862000, end_id=1719219521724862001) [2024-06-24 16:58:41.726285] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:41.730432] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=21] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:41.748894] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [1581][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=22][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1003, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:41.749025] WDIAG read_multi_row (ob_table_access_helper.h:238) [1581][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=49][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1003, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:41.752135] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219521751289000, start_id=1719219521751289000, end_id=1719219521751289001) [2024-06-24 16:58:41.752140] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1169727-0-0] [lt=20] [APPLY STAT CB APPEND COST TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=32, this=0x7f473495c280, extra_info="") [2024-06-24 16:58:41.752166] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1169727-0-0] [lt=25] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=398, this=0x7f473495c4b0, extra_info="") [2024-06-24 16:58:41.752179] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1169727-0-0] [lt=12] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=0, this=0x7f473495c6e0, extra_info="") [2024-06-24 16:58:41.752195] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1169727-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=-541, this=0x7f473495c910, extra_info="") [2024-06-24 16:58:41.752209] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA1169727-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=-110, this=0x7f473495cb40, extra_info="") [2024-06-24 16:58:41.752212] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:41.752240] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:41.752613] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=348, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:41.752658] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:41.752655] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A577B-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219521752345000, start_id=1719219521752345000, end_id=1719219521752345001) [2024-06-24 16:58:41.752693] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:41.752716] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=412, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:41.752734] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=25, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:41.756970] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.762412] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=8037, mem_used=83189760) [2024-06-24 16:58:41.768610] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:41.768643] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:41.771843] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82300000, replace_num=100000) [2024-06-24 16:58:41.771864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:41.779542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283456925696, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:41.781414] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.786751] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=31] new mysql sessid created(conn.sessid_=3221494474, support_ssl=false) [2024-06-24 16:58:41.786835] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=47] sm conn init succ(conn.sessid_=3221494474, sess.client_addr_="172.20.17.86:49516") [2024-06-24 16:58:41.786861] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f46bf5f6030, session_id:3221494474, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:41.786941] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=34][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6030, session_id:3221494474, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:41.786978] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=32] kill and revert session(conn.sessid_=3221494474, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:41.786995] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f46bf5f6030, session_id:3221494474, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:41.787019] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494474) [2024-06-24 16:58:41.787036] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221494474, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:41.789323] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219521789210000, start_id=1719219521789210000, end_id=1719219521789210001) [2024-06-24 16:58:41.790196] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE34B-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:41.793329] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE34C-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:41.799036] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE34E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:41.802179] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE34F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:41.803127] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5789-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:41.805246] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE350-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:41.811380] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219521810334000, start_id=1719219521810334000, end_id=1719219521810334001) [2024-06-24 16:58:41.823192] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:41.823239] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=31] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1234) [2024-06-24 16:58:41.825781] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=14] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=32, mem_used=49913856) [2024-06-24 16:58:41.825822] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=29] release old cannot free more memory [2024-06-24 16:58:41.825843] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=63, size_used=0, mem_used=49913856) [2024-06-24 16:58:41.831607] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE359-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:41.834720] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE35A-0-0] [lt=53][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:41.835422] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [1558][T1003_TntShared][T1003][Y0-0000000000000000-0-0] [lt=16] dump dtl interm result cost(us)(dump_cost=6, ret=0, interm count=0, dump count=617) [2024-06-24 16:58:41.835462] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [1558][T1003_TntShared][T1003][Y0-0000000000000000-0-0] [lt=35] clear dtl interm result cost(us)(clear_cost=4, ret=0, gc_.expire_keys_.count()=0, dump count=617, interm count=0, clean count=0) [2024-06-24 16:58:41.839736] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE35C-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:41.841563] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=404, avg_log_submit_to_slide_time=416) [2024-06-24 16:58:41.842460] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:41.842526] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:41.842635] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:41.842672] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:41.842748] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:41.842792] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:41.842840] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11697DB-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:41.851224] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219521850490000, start_id=1719219521850490000, end_id=1719219521850490001) [2024-06-24 16:58:41.851260] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=22] ts response task statistics(alloc_count=248442, free_count=124220) [2024-06-24 16:58:41.851291] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=18] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219521851217], gts:1719219521850490000, latest_srr:[mts=1719219521851217]}) [2024-06-24 16:58:41.851335] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219521851318], gts:1719219521850490000, latest_srr:[mts=1719219521851318]}) [2024-06-24 16:58:41.851365] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219521851351], gts:1719219521850490000, latest_srr:[mts=1719219521851351]}) [2024-06-24 16:58:41.851393] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219521851381], gts:1719219521850490000, latest_srr:[mts=1719219521851381]}) [2024-06-24 16:58:41.855165] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE35E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:41.857022] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.857163] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=26] current monitor number(seq_=-1) [2024-06-24 16:58:41.864056] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219521863147000, start_id=1719219521863147000, end_id=1719219521863147001) [2024-06-24 16:58:41.873131] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.873639] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.873648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.873649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.873650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.873829] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.873972] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874123] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874448] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874448] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874457] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874503] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874535] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874639] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874640] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874659] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874661] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874658] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874706] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.874721] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:41.881471] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.895996] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE36A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:41.899007] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE36B-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:41.911706] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:41.920271] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:262) [1665][T1004_ArcSender][T1004][YB42AC141156-00061B9D95E0C0E5-0-0] [lt=33] ObArchiveSender is running(thread_index=6) [2024-06-24 16:58:41.925478] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1719219521925263000, start_id=1719219521925263000, end_id=1719219521925263001) [2024-06-24 16:58:41.946953] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=32] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16493, offset=3757799}, end_cursor:ObLogCursor{file_id=1, log_id=16494, offset=3758072}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cb4050, len:2329, log_data_len:273, seq:16493, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:41.949069] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D901-0-0] [lt=35] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.334374136924743652e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=667, Throttle Trigger(MB)=400, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.949462451897566950e+01) [2024-06-24 16:58:41.951016] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D901-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219521950556000, start_id=1719219521950556000, end_id=1719219521950556001) [2024-06-24 16:58:41.951109] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D901-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7761, avg_group_log_size=646) [2024-06-24 16:58:41.951139] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D901-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7763) [2024-06-24 16:58:41.951451] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7761) [2024-06-24 16:58:41.951501] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7761) [2024-06-24 16:58:41.951537] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=387, avg_log_submit_to_slide_time=398) [2024-06-24 16:58:41.952159] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16494, offset=3758072}, end_cursor:ObLogCursor{file_id=1, log_id=16495, offset=3758337}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cb8050, len:2056, log_data_len:265, seq:16494, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:41.952202] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219521951611000, start_id=1719219521951611000, end_id=1719219521951611001) [2024-06-24 16:58:41.954483] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE37E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:41.957076] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.966694] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1719219521966692, bytes: 170838257, bw: 0.018589 MB/s, add_ts: 1007609, add_bytes: 19640 [2024-06-24 16:58:41.968335] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:41.968368] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:41.968392] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:41.968411] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:41.968443] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:41.968744] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:41.968788] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=702, avg_log_submit_to_slide_time=711) [2024-06-24 16:58:41.968814] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=11, stat_interval=5000000, avg (count/cost)=65, this=0x7f46d7ab8280, extra_info="") [2024-06-24 16:58:41.968856] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=41] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=11, stat_interval=5000000, avg (count/cost)=406, this=0x7f46d7ab84b0, extra_info="") [2024-06-24 16:58:41.968873] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=11, stat_interval=5000000, avg (count/cost)=0, this=0x7f46d7ab86e0, extra_info="") [2024-06-24 16:58:41.968888] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=11, stat_interval=5000000, avg (count/cost)=-542, this=0x7f46d7ab8910, extra_info="") [2024-06-24 16:58:41.968902] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=11, stat_interval=5000000, avg (count/cost)=-70, this=0x7f46d7ab8b40, extra_info="") [2024-06-24 16:58:41.968973] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=642, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:41.971936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:41.976351] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=7] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:41.980030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283454828544, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:41.981531] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:41.989507] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219521988551000, start_id=1719219521988551000, end_id=1719219521988551001) [2024-06-24 16:58:42.003013] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:42.006690] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:787) [163649][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=36] ps cache evict(tenant_id=1, stmt_id_map_.size()=12, stmt_info_map_.size()=12, op.get_used_size()=26439, get_mem_high()=410706180, expired_stmt_ids.count()=0, closed_stmt_ids.count()=12) [2024-06-24 16:58:42.011580] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219522010689000, start_id=1719219522010689000, end_id=1719219522010689001) [2024-06-24 16:58:42.012168] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:42.018614] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [162957][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=19] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f4841ffc2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:42.028178] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=11] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1004) [2024-06-24 16:58:42.028215] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=33] start lib cache evict(tenant_id=1004, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:42.028239] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=21] end lib cache evict(tenant_id=1004, cache_evict_num=0, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:42.028260] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:42.031342] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1453][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=44] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:42.035020] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=497, alloc_obj_list=[{obj_id:35, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:39, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:40, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184250}, {obj_id:41, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:43, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:45, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:53, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175298}, {obj_id:84, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174332}, {obj_id:145, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:146, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:147, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:148, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:151, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:152, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:153, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:154, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:155, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:156, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:157, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:158, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:159, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:160, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198897}, {obj_id:161, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:162, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:163, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:164, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:165, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:166, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:167, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:168, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:169, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:170, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:171, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:172, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:173, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:174, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:175, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:176, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:177, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175451}, {obj_id:178, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181217}, {obj_id:179, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:180, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:181, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:182, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235894}, {obj_id:183, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209782}, {obj_id:184, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230576}, {obj_id:185, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:186, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:187, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:188, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:189, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:190, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:191, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:192, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:193, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:195, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:196, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:197, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:198, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:199, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:200, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:201, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:202, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:203, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:204, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:205, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:206, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:207, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:208, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:209, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:210, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:211, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:212, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:213, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:214, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:215, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:216, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299219}, {obj_id:217, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236649}, {obj_id:218, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:219, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184514}, {obj_id:220, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:221, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:222, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:223, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180301}, {obj_id:224, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:225, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:226, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:227, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:228, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183169}, {obj_id:229, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:230, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:232, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:235, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:236, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:237, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:238, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:239, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:240, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:241, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:242, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188148}, {obj_id:243, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:244, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:245, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:246, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:247, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:248, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:249, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:250, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:251, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:252, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:253, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:254, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:255, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206580}, {obj_id:256, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208496}, {obj_id:257, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:258, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308540}, {obj_id:260, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207652}, {obj_id:261, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:262, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172752}, {obj_id:263, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:264, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:265, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:266, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:267, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:268, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:269, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:270, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:271, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:272, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157105}, {obj_id:273, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175095}, {obj_id:274, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176760}, {obj_id:275, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185989}, {obj_id:276, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:277, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:278, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:279, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419083}, {obj_id:280, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417152}, {obj_id:283, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239831}, {obj_id:284, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242976}, {obj_id:285, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256105}, {obj_id:286, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256298}, {obj_id:287, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:288, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:289, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:290, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:291, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:292, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:293, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:294, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231047}, {obj_id:295, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:296, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:297, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:298, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:299, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215340}, {obj_id:300, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:301, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:302, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:303, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:304, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:307, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:308, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:311, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:375291}, {obj_id:312, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:384468}, {obj_id:313, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325700}, {obj_id:314, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:334948}, {obj_id:315, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227240}, {obj_id:316, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268192}, {obj_id:317, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200156}, {obj_id:318, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206516}, {obj_id:335, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182820}, {obj_id:349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191406}, {obj_id:352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:362, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204485}, {obj_id:363, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224055}, {obj_id:366, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185366}, {obj_id:367, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195268}, {obj_id:368, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:375, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:376, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:379, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:380, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234934}, {obj_id:381, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:382, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:383, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:384, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218544}, {obj_id:385, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:386, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:387, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:388, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:391, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189184}, {obj_id:392, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201018}, {obj_id:395, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191754}, {obj_id:396, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204870}, {obj_id:399, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:400, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:403, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:404, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:407, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:408, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199110}, {obj_id:411, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:412, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:425, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:426, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:427, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:428, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:429, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:430, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217209}, {obj_id:431, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:432, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:433, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:434, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:437, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201929}, {obj_id:438, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220211}, {obj_id:441, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186646}, {obj_id:442, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197186}, {obj_id:449, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187051}, {obj_id:450, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236235}, {obj_id:451, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291681}, {obj_id:452, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229118}, {obj_id:453, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200168}, {obj_id:454, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219871}, {obj_id:455, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201375}, {obj_id:456, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291677}, {obj_id:457, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181926}, {obj_id:458, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201455}, {obj_id:461, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198111}, {obj_id:462, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214476}, {obj_id:473, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212131}, {obj_id:474, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235568}, {obj_id:489, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203200}, {obj_id:490, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222135}, {obj_id:493, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:494, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:497, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252923}, {obj_id:498, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296972}, {obj_id:509, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:510, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237536}, {obj_id:511, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292049}, {obj_id:512, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229486}, {obj_id:513, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200544}, {obj_id:514, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221206}, {obj_id:515, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201791}, {obj_id:516, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292045}, {obj_id:517, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182278}, {obj_id:518, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201839}, {obj_id:521, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263105}, {obj_id:522, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312324}, {obj_id:527, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269484}, {obj_id:528, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321943}, {obj_id:537, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254176}, {obj_id:538, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:298902}, {obj_id:551, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251638}, {obj_id:552, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295058}, {obj_id:555, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223603}, {obj_id:556, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252824}, {obj_id:573, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190308}, {obj_id:574, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238837}, {obj_id:575, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292385}, {obj_id:576, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229822}, {obj_id:577, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200872}, {obj_id:578, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222549}, {obj_id:579, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202111}, {obj_id:580, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292381}, {obj_id:581, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182630}, {obj_id:582, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202159}, {obj_id:587, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:588, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:611, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205738}, {obj_id:612, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225979}, {obj_id:625, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274568}, {obj_id:626, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329621}, {obj_id:643, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:644, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:645, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206454}, {obj_id:646, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:647, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:648, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:649, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197356}, {obj_id:650, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178512}, {obj_id:651, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198928}, {obj_id:652, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199105}, {obj_id:653, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156378}, {obj_id:654, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157162}, {obj_id:655, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176121}, {obj_id:656, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:657, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:307685}, {obj_id:658, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:660, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312830}, {obj_id:661, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:662, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:663, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:664, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202402}, {obj_id:665, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:666, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216429}, {obj_id:667, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:668, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157107}, {obj_id:669, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176570}, {obj_id:670, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176412}, {obj_id:672, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:673, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156195}, {obj_id:674, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:676, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:677, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372653}, {obj_id:678, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:679, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:680, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255326}, {obj_id:681, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255084}, {obj_id:682, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281876}, {obj_id:683, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319873}, {obj_id:684, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209231}, {obj_id:700, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192790}, {obj_id:701, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257630}, {obj_id:702, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234000}, {obj_id:731, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200128}, {obj_id:733, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:409897}, {obj_id:734, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:400862}, {obj_id:736, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175113}, {obj_id:737, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184566}, {obj_id:742, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175296}, {obj_id:743, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181792}, {obj_id:746, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185582}, {obj_id:747, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:797, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200312}, {obj_id:798, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198098}, {obj_id:799, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288253}, {obj_id:800, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:801, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200393}, {obj_id:802, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213250}, {obj_id:803, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328028}, {obj_id:804, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198852}, {obj_id:805, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:806, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:807, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:808, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:809, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174410}, {obj_id:815, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173948}, {obj_id:825, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185181}, {obj_id:828, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238944}, {obj_id:832, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:833, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:834, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:835, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:836, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188748}, {obj_id:837, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207583}, {obj_id:838, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220441}, {obj_id:839, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189684}, {obj_id:840, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183154}, {obj_id:841, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246969}, {obj_id:842, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249608}, {obj_id:843, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231450}, {obj_id:844, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180118}, {obj_id:845, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268752}, {obj_id:846, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270542}, {obj_id:847, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270227}, {obj_id:848, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273208}, {obj_id:849, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257627}, {obj_id:850, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273232}, {obj_id:851, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254489}, {obj_id:852, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269717}, {obj_id:853, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175231}, {obj_id:854, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181662}, {obj_id:855, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177134}, {obj_id:861, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177715}, {obj_id:869, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187847}, {obj_id:879, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200764}, {obj_id:880, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200755}, {obj_id:930, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:466821}, {obj_id:931, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:932, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296709}, {obj_id:933, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318958}, {obj_id:934, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312747}, {obj_id:935, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325200}, {obj_id:936, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217553}, {obj_id:937, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281577}, {obj_id:938, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189394}, {obj_id:939, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:641561}, {obj_id:940, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:244732}, {obj_id:941, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232660}, {obj_id:942, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:943, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:944, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217413}, {obj_id:945, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189522}, {obj_id:946, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232546}, {obj_id:1073, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246494}, {obj_id:1140, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:378647}, {obj_id:1141, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306509}, {obj_id:1142, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1143, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:1144, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198777}, {obj_id:1194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247404}, {obj_id:1320, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:438066}, {obj_id:1321, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260903}, {obj_id:1322, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206816}, {obj_id:1323, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193061}, {obj_id:1324, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178317}, {obj_id:1325, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182140}, {obj_id:1326, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174724}, {obj_id:1327, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195853}, {obj_id:1328, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184944}, {obj_id:1329, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201089}, {obj_id:1330, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209476}, {obj_id:1331, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:170609}, {obj_id:1332, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171169}, {obj_id:1333, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203806}, {obj_id:1334, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200651}, {obj_id:1336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195256}, {obj_id:1337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203334}, {obj_id:1338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198057}, {obj_id:1339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192160}, {obj_id:1340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194971}, {obj_id:1341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196164}, {obj_id:1342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198958}, {obj_id:1343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197940}, {obj_id:1344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200683}, {obj_id:1345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197036}, {obj_id:1346, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199801}, {obj_id:1347, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204590}, {obj_id:1348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197459}, {obj_id:1349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207323}, {obj_id:1350, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200262}, {obj_id:1351, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197164}, {obj_id:1353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199224}, {obj_id:1354, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201933}, {obj_id:1355, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202018}, {obj_id:1356, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206006}, {obj_id:1357, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204664}, {obj_id:1358, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205068}, {obj_id:1359, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208689}, {obj_id:1360, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207750}, {obj_id:1361, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209040}, {obj_id:13 [2024-06-24 16:58:42.036713] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=1689] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:42.044862] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 374.00) [2024-06-24 16:58:42.044890] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:42.044966] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 375.50) [2024-06-24 16:58:42.044977] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:42.045003] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045014] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045032] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045039] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045048] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045066] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045086] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045093] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045102] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045109] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045126] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.045133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:42.054962] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:42.057130] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.057658] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC11-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103418149027, cache_obj->added_lc()=false, cache_obj->get_object_id()=9364, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:42.058945] WDIAG get_refactored (ob_hashtable.h:1102) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC13-0-0] [lt=38][errcode=-4201] hashtable not init [2024-06-24 16:58:42.058966] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC13-0-0] [lt=20][errcode=-4016] get cursor info failed(cursor_id=1151, get_sessid()=3221489125) [2024-06-24 16:58:42.059137] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB52-0-0] [lt=22] submit log success(service_type_=0, last_id=1719219538711542000, limited_id=1719219538711542000) [2024-06-24 16:58:42.059168] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB52-0-0] [lt=30] submit log with lock success(service_type_=0, last_id=1719219538711542000, limited_id=1719219538711542000) [2024-06-24 16:58:42.059184] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB52-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219522058160000, start_id=1719219522058160000, end_id=1719219522058160001) [2024-06-24 16:58:42.059867] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=5] update id meta(ret=0, service_type=0, limited_id=1719219538711542000, latest_scn={val:1719219522058160001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:42.059946] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=77] handle submit callback(service_type_=0, success=true, used_ts=810, log_ts={val:1719219522058160001, v:0}, limited_id=1719219538711542000) [2024-06-24 16:58:42.059965] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=18] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:42.059982] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:42.062716] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8B70FBE9-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219522062385000, start_id=1719219522062385000, end_id=1719219522062385001) [2024-06-24 16:58:42.064365] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219522063442000, start_id=1719219522063442000, end_id=1719219522063442001) [2024-06-24 16:58:42.075963] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:42.076003] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:42.076032] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:42.076055] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:42.076376] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=351, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:42.076378] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=696, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:42.076408] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=10, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:42.076411] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:42.076427] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=4, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:42.076450] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=770, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:42.076466] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=20, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:42.076488] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:42.076504] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=414, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:42.076517] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=19, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:42.079482] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=15] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:42.079513] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=20] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:42.079533] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1233) [2024-06-24 16:58:42.081589] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.096259] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=815, mem_used=2079744) [2024-06-24 16:58:42.096526] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096649] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096859] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096913] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096971] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096987] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.096989] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097068] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097069] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097307] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097599] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097656] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097661] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097671] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097683] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097686] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097762] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097780] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.097787] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098100] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098101] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098226] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098291] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098371] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098384] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098441] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098601] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098637] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098695] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.098815] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.099204] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.099471] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.111791] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:42.111818] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:42.111849] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=73573884, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:42.114210] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD20-0-0] [lt=19] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:42.114235] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD20-0-0] [lt=17] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=26) [2024-06-24 16:58:42.114634] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=29] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:42.124122] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169973-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:42.125384] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219522124611000, start_id=1719219522124611000, end_id=1719219522124611001) [2024-06-24 16:58:42.126887] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3BB-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:42.127452] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:42.131843] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3BD-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:42.134241] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:42.134480] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3BE-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:42.135247] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=20] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:42.137304] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3BF-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:42.152433] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219522152085000, start_id=1719219522152085000, end_id=1719219522152085001) [2024-06-24 16:58:42.153376] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=19] ====== traversal_flush timer task ====== [2024-06-24 16:58:42.153544] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B6-0-0] [lt=17] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:42.153699] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B6-0-0] [lt=147] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:42.156537] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DE-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:42.156573] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DE-0-0] [lt=33] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:42.157188] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.158262] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F9-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:42.158297] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8F9-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:42.160559] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3C8-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:42.164378] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11699A6-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:42.168500] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:42.168871] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:42.168889] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:42.168915] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=700, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:42.168934] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:42.169070] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CA-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:42.171749] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:42.171846] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:42.172011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:42.172017] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:42.172074] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:42.172216] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:42.172283] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:42.172372] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3CC-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:42.175585] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=23] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:42.180518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283452731392, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:42.181629] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.182875] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D42C-0-0] [lt=21] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:42.184890] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA11699C0-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:42.189577] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219522189089000, start_id=1719219522189089000, end_id=1719219522189089001) [2024-06-24 16:58:42.197903] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:42.198076] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B6-0-0] [lt=18] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219519750492000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:42.198438] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B6-0-0] [lt=120] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219521851547004, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219519750492000, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:42.198548] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B6-0-0] [lt=107] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:42.201504] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:465) [162928][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=22] skip defragment task(ret=0, need_defragment=false) [2024-06-24 16:58:42.201549] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:507) [162928][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=37] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=3) [2024-06-24 16:58:42.201571] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:525) [162928][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=21] successfully defragment data blocks(rewrite_cnt=0) [2024-06-24 16:58:42.201589] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:697) [162928][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=14] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=0, total_skip_cnt=0, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2024-06-24 16:58:42.201708] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:42.211594] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219522211214000, start_id=1719219522211214000, end_id=1719219522211214001) [2024-06-24 16:58:42.222037] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3DC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:42.224651] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3DD-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:42.227439] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D47A-0-0] [lt=12] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:42.227543] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D47C-0-0] [lt=15] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:42.227941] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:42.229742] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=33] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:42.229846] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=31] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516793682000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:42.241389] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:42.241422] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:42.241782] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:42.241810] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=718, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:42.241829] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=34, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:42.257243] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.264304] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219522263975000, start_id=1719219522263975000, end_id=1719219522263975001) [2024-06-24 16:58:42.274245] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE3F1-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:42.280141] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=17] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:42.280169] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=27] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:42.280178] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E2-0-0] [lt=22] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:42.280217] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E2-0-0] [lt=32] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:42.281684] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.319913] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AA-0-0] [lt=47][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:42.319943] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AA-0-0] [lt=29][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:42.325701] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219522325292000, start_id=1719219522325292000, end_id=1719219522325292001) [2024-06-24 16:58:42.325785] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4098, avg_group_log_size=372) [2024-06-24 16:58:42.325813] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4098) [2024-06-24 16:58:42.326088] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4098) [2024-06-24 16:58:42.326122] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4098) [2024-06-24 16:58:42.326352] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112008, mem_used=264127488) [2024-06-24 16:58:42.329912] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1387][T1004_ArcSender][T1004][YB42AC141156-00061B9D9370C0E5-0-0] [lt=21][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:42.336846] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:146) [162983][T1_CompactionRe][T1][YB42AC141156-00061B9D8AC0C1C9-0-0] [lt=28] InfoPoolResizeTask(cost_ts=97) [2024-06-24 16:58:42.343215] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:42.344865] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=20] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:42.345003] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=136] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:42.345074] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=20] dump tenant replay process(tenant_id=1, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:42.352179] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219522351687000, start_id=1719219522351687000, end_id=1719219522351687001) [2024-06-24 16:58:42.352225] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:42.352425] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219522351687000, start_id=1719219522351687001, end_id=1719219522351687002) [2024-06-24 16:58:42.352661] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=18] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=365, get_gts_with_stc_cnt=5, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=1, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:42.357298] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.366377] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [162948][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:42.366494] WDIAG read_multi_row (ob_table_access_helper.h:238) [162948][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=35][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:42.368606] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:42.368682] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=67] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:42.372085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:42.374880] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=33] success to update min reserved snapshot(reserved_snapshot=1719217716701057000, duration=1800, snapshot_gc_ts=1719219516701057000) [2024-06-24 16:58:42.375156] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1719219512373186, end_time=1719219522375152, dag_status={}) [2024-06-24 16:58:42.375193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=34] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375216] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375232] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375261] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375303] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:42.375328] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375348] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375380] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375412] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375423] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=20] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217716701057000) [2024-06-24 16:58:42.375428] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375443] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=17] update reserved snapshot finished(cost_ts=568, reserved_snapshot=1719217716701057000) [2024-06-24 16:58:42.375442] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375456] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375488] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375504] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375520] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375536] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375551] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375583] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375645] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375662] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375678] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375694] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375709] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375725] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375772] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375803] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375819] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375866] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375882] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375930] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375961] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.375995] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376038] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376070] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376086] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376117] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376133] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376149] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376144] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:42.376164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376172] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:42.376180] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376194] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376210] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376226] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:42.376275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:42.376290] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:42.376304] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:42.376315] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:42.376326] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:42.376337] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:42.376348] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:42.376358] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:42.376369] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:42.376380] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:42.376395] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:42.376486] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1098) [2024-06-24 16:58:42.381004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283450634240, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:42.381742] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.389603] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219522388698000, start_id=1719219522388698000, end_id=1719219522388698001) [2024-06-24 16:58:42.404604] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D442-0-0] [lt=16] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:42.411712] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1719219522410900000, start_id=1719219522410900000, end_id=1719219522410900001) [2024-06-24 16:58:42.411786] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:42.411820] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:42.412172] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=351, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:42.412207] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:42.412237] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=5, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:42.412263] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=406, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:42.412280] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=18, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:42.420805] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129773, mem_used=326519808) [2024-06-24 16:58:42.438450] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19F97C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:42.441468] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE42A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:42.446505] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE42C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:42.449608] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19F98D-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:42.452350] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE42D-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:42.457353] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.463083] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=27] ====== tenant freeze timer task ====== [2024-06-24 16:58:42.464402] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219522463689000, start_id=1719219522463689000, end_id=1719219522463689001) [2024-06-24 16:58:42.464985] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219521850490002, v:0}, new_max_version={val:1719219521850490002, v:0}, last_min_version={val:1719219521850490000, v:0}, last_max_version={val:1719219521850490000, v:0}, total_time_us=2510, delta_us=614494) [2024-06-24 16:58:42.465019] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219521850490002, v:0}, min_version={val:1719219521850490002, v:0}, max_version={val:1719219521850490002, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:42.471365] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:42.473063] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=33] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:42.473161] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=27] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516741149000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:42.475975] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE436-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:42.476568] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=379, avg_log_submit_to_slide_time=386) [2024-06-24 16:58:42.478728] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE437-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:42.481248] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:42.481786] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.483079] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE438-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:42.483851] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] Garbage Collector is running(seq_=628, gc_interval=10000000) [2024-06-24 16:58:42.483930] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=33] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:42.483964] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] gc_check_member_list_ cost time(ret=0, time_us=77) [2024-06-24 16:58:42.483983] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:42.483999] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:42.484021] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:42.484038] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] execute_gc cost time(ret=0, time_us=18) [2024-06-24 16:58:42.484051] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2024-06-24 16:58:42.484559] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:42.484614] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=39] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1254) [2024-06-24 16:58:42.485784] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:42.485880] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:42.486052] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:42.486110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:42.486250] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:42.486320] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:42.486409] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:42.498725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE43B-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:42.519781] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E936-0-0] [lt=11] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:42.519936] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E936-0-0] [lt=32][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:42.523887] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=18] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1719219522325292000, v:0}, base_version={val:1719219522124611000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219522325292000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219522523872, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:42.525870] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219522524975000, start_id=1719219522524975000, end_id=1719219522524975001) [2024-06-24 16:58:42.526259] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=589, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:42.526275] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:42.527758] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=19] ls blacklist refresh finish(cost_time=11843) [2024-06-24 16:58:42.528671] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:42.536247] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE449-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:42.539491] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE44A-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:42.540018] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=61] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:42.552555] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219522552430000, start_id=1719219522552430000, end_id=1719219522552430001) [2024-06-24 16:58:42.554515] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=29] success to update min reserved snapshot(reserved_snapshot=1719217716741149000, duration=1800, snapshot_gc_ts=1719219516741149000) [2024-06-24 16:58:42.555057] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=19] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217716741149000) [2024-06-24 16:58:42.555076] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=16] update reserved snapshot finished(cost_ts=564, reserved_snapshot=1719217716741149000) [2024-06-24 16:58:42.557408] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.565663] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB53-0-0] [lt=17][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103418657027, cache_obj->added_lc()=false, cache_obj->get_object_id()=9365, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:42.571657] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8375) [2024-06-24 16:58:42.572153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:42.576294] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=3374, avg_group_log_size=281) [2024-06-24 16:58:42.576326] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3374) [2024-06-24 16:58:42.581477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283450634240, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:42.581845] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.585381] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D42C-0-0] [lt=24] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:42.589799] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1719219522589326000, start_id=1719219522589326000, end_id=1719219522589326001) [2024-06-24 16:58:42.591926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE45E-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:42.603968] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1719219522603965, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-06-24 16:58:42.606184] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13742, offset=3451592}, end_cursor:ObLogCursor{file_id=1, log_id=13743, offset=3451865}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cbc050, len:1336, log_data_len:273, seq:13742, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:42.606955] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:42.608969] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D911-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219522608281000, start_id=1719219522608281000, end_id=1719219522608281001) [2024-06-24 16:58:42.609035] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D911-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=9498, avg_group_log_size=527) [2024-06-24 16:58:42.609055] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D911-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8497) [2024-06-24 16:58:42.609406] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8373) [2024-06-24 16:58:42.609426] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=387, avg_log_submit_to_slide_time=394) [2024-06-24 16:58:42.609902] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=34] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13743, offset=3451865}, end_cursor:ObLogCursor{file_id=1, log_id=13744, offset=3452130}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cc0050, len:1063, log_data_len:265, seq:13743, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:42.611846] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219522611440000, start_id=1719219522611440001, end_id=1719219522611440002) [2024-06-24 16:58:42.620885] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:42.621204] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:42.627605] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [162940][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=28] finish to resize log external storage handler(current_ts=1719219522627593, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:42.657463] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.664566] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219522664138000, start_id=1719219522664138000, end_id=1719219522664138001) [2024-06-24 16:58:42.668764] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA12573FC-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219522668367000, start_id=1719219522668367000, end_id=1719219522668367001) [2024-06-24 16:58:42.669161] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1342) [2024-06-24 16:58:42.669163] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=383, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:42.669196] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:42.669227] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:42.669256] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=467, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:42.669276] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=22, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:42.669307] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=413, avg_log_submit_to_slide_time=426) [2024-06-24 16:58:42.669403] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3252) [2024-06-24 16:58:42.669446] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=3252) [2024-06-24 16:58:42.669480] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=405, avg_log_submit_to_slide_time=414) [2024-06-24 16:58:42.669505] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9D9B19F4FE-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219522669425000, start_id=1719219522669425000, end_id=1719219522669425001) [2024-06-24 16:58:42.681901] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.683678] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19FAC6-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1719219522683148000, start_id=1719219522683148000, end_id=1719219522683148001) [2024-06-24 16:58:42.691333] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD54-0-0] [lt=31] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:42.700201] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:42.723454] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=32][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:42.725931] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219522725346000, start_id=1719219522725346000, end_id=1719219522725346001) [2024-06-24 16:58:42.725998] INFO [STORAGE] normal_running_env_check_ (ob_tenant_snapshot_service.cpp:279) [458][T1002_TSnapSvc][T1002][Y0-0000000000000000-0-0] [lt=21] normal_running_env_check_ succ(this={is_inited_:true, is_running_:true, running_mode_:3, meta_loaded_:true, tg_id_:473}) [2024-06-24 16:58:42.725973] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [163714][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=60] BlockGCTimerTask success(ret=0, cost_time_us=9, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):22118, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):22118, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):460, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:42.726039] INFO [STORAGE] try_gc_tenant_snapshot_ (ob_tenant_snapshot_service.cpp:650) [458][T1002_TSnapSvc][T1002][Y0-0000000000000000-0-0] [lt=39] try_gc_tenant_snapshot finished(ret=0, ret="OB_SUCCESS", this={is_inited_:true, is_running_:true, running_mode_:3, meta_loaded_:true, tg_id_:473}) [2024-06-24 16:58:42.726870] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=21] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:42.727706] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D442-0-0] [lt=13] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:42.728334] INFO [STORAGE] calculate_idle_time_ (ob_tenant_snapshot_service.cpp:829) [458][T1002_TSnapSvc][T1002][Y0-0000000000000000-0-0] [lt=27] ObTenantSnapshotService thread idle time(tg_id_=473, idle_time=60000, running_mode_=3) [2024-06-24 16:58:42.728605] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:42.728721] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516806320000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:42.730511] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=19] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:42.745840] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=64] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:42.752712] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219522752661000, start_id=1719219522752661000, end_id=1719219522752661001) [2024-06-24 16:58:42.752787] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:42.752821] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:42.752978] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A57F8-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219522752661000, start_id=1719219522752661000, end_id=1719219522752661001) [2024-06-24 16:58:42.752981] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EC2-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219522752661000, start_id=1719219522752661001, end_id=1719219522752661002) [2024-06-24 16:58:42.752992] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92E4-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219522752661000, start_id=1719219522752661002, end_id=1719219522752661003) [2024-06-24 16:58:42.753159] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=345, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:42.753177] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=13, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:42.753219] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:42.753249] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=409, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:42.753269] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=27, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:42.753487] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A57F8-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219522752661000, start_id=1719219522752661003, end_id=1719219522752661004) [2024-06-24 16:58:42.755722] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:42.757349] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=29] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:42.757441] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=25] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219517123751000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:42.757520] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.758355] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041DAE-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:42.761242] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE49B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:42.762544] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=11379, mem_used=91508736) [2024-06-24 16:58:42.766681] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE49D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:42.769258] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:42.769279] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:42.769391] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE49E-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:42.772140] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE49F-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:42.772222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:42.781961] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.781980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283444342784, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:42.785746] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494475, support_ssl=false) [2024-06-24 16:58:42.785834] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=26] sm conn init succ(conn.sessid_=3221494475, sess.client_addr_="172.20.17.86:49518") [2024-06-24 16:58:42.785856] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=16] accept one succ(*s={this:0x7f47833c2030, session_id:3221494475, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:42.785924] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494475, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:42.785956] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221494475, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:42.785973] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494475, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:42.785996] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494475) [2024-06-24 16:58:42.786009] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494475, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:42.789870] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219522789507000, start_id=1719219522789507000, end_id=1719219522789507001) [2024-06-24 16:58:42.795342] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4A8-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:42.798218] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4A9-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:42.802406] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AB-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:42.804614] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:42.804725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:42.804900] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:42.804987] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=43][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:42.805128] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:42.805193] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:42.805280] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4AD-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:42.811498] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169CD2-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:42.811768] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=11] ====== check clog disk timer task ====== [2024-06-24 16:58:42.811790] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=15] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:42.811812] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=12] cannot_recycle_log_size statistics(cannot_recycle_log_size=53484555, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:42.811939] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219522811610000, start_id=1719219522811610000, end_id=1719219522811610001) [2024-06-24 16:58:42.825961] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=21] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=39, mem_used=49913856) [2024-06-24 16:58:42.826011] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=27] release old cannot free more memory [2024-06-24 16:58:42.826026] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=66, size_used=0, mem_used=49913856) [2024-06-24 16:58:42.838407] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:42.838448] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=32] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:42.838473] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=22] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1251) [2024-06-24 16:58:42.842091] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=58, avg_log_gen_to_submit_time=68, avg_log_submit_to_flush_time=602, avg_log_submit_to_slide_time=615) [2024-06-24 16:58:42.844986] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4BC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:42.847410] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4BD-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:42.853035] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219522852802000, start_id=1719219522852802000, end_id=1719219522852802001) [2024-06-24 16:58:42.853117] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] gts statistics(tenant_id=1003, gts_rpc_cnt=10, get_gts_cache_cnt=404, get_gts_with_stc_cnt=61, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=61, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:42.857274] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=18] current monitor number(seq_=-1) [2024-06-24 16:58:42.857574] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:42.857596] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:42.857609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.864573] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219522864428000, start_id=1719219522864428000, end_id=1719219522864428001) [2024-06-24 16:58:42.872904] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.873917] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.873930] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.873955] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874005] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874096] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874101] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874111] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874113] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874189] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874311] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874506] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874579] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874663] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874660] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874703] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874708] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.874720] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:42.878812] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [825][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=54] BlockGCTimerTask success(ret=0, cost_time_us=16, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):2457, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):2457, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):131, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:42.882017] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.884720] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:153) [1472][T1003_COMMONLSS][T1003][YB42AC141156-00061B9D9940D8A5-0-0] [lt=38][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2024-06-24 16:58:42.891459] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE4CF-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:42.907273] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=25] ====== traversal_flush timer task ====== [2024-06-24 16:58:42.907523] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CA-0-0] [lt=33] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:42.907670] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CA-0-0] [lt=140] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:42.911768] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=27] gc stale ls task succ [2024-06-24 16:58:42.926062] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219522925631000, start_id=1719219522925631000, end_id=1719219522925631001) [2024-06-24 16:58:42.929939] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=53] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:42.938597] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=10] Garbage Collector is running(seq_=618, gc_interval=10000000) [2024-06-24 16:58:42.938676] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=40] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:42.938709] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=19] gc_check_member_list_ cost time(ret=0, time_us=68) [2024-06-24 16:58:42.938729] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=15] execute_gc cost time(ret=0, time_us=0) [2024-06-24 16:58:42.940478] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=11] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:42.940512] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=27] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:42.940531] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=21) [2024-06-24 16:58:42.940545] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:42.952606] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E13886-0-0] [lt=14] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336774077415466309e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.885603957301398736e+01) [2024-06-24 16:58:42.952842] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=66] get number(ret=0, service_type_=0, range=1, base_id=1719219522951982000, start_id=1719219522951982000, end_id=1719219522951982001) [2024-06-24 16:58:42.952920] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7339, avg_group_log_size=564) [2024-06-24 16:58:42.952947] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7874) [2024-06-24 16:58:42.953214] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7339) [2024-06-24 16:58:42.953251] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7339) [2024-06-24 16:58:42.953290] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=369, avg_log_submit_to_slide_time=382) [2024-06-24 16:58:42.956180] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=22] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16495, offset=3758337}, end_cursor:ObLogCursor{file_id=1, log_id=16496, offset=3758610}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cc4050, len:1791, log_data_len:273, seq:16495, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:42.957634] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=7][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.958066] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:42.960163] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D902-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219522959371000, start_id=1719219522959371000, end_id=1719219522959371001) [2024-06-24 16:58:42.961165] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16496, offset=3758610}, end_cursor:ObLogCursor{file_id=1, log_id=16497, offset=3758875}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cc8050, len:1518, log_data_len:265, seq:16496, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:42.969002] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:42.969045] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:42.969071] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:42.969100] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:42.969140] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:42.969418] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:42.969453] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=441, avg_log_submit_to_slide_time=449) [2024-06-24 16:58:42.969651] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=365, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:42.972290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:42.974310] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1719219522974308, bytes: 170859312, bw: 0.019928 MB/s, add_ts: 1007616, add_bytes: 21055 [2024-06-24 16:58:42.976871] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:42.982076] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:42.982463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283442245632, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:42.990024] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219522989947000, start_id=1719219522989947000, end_id=1719219522989947001) [2024-06-24 16:58:42.992268] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=46] LogLoopThread round_cost_time(us)(round_cost_time=10) [2024-06-24 16:58:43.003074] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:43.004899] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=17716688, clean_num=201326) [2024-06-24 16:58:43.011028] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:174) [1331][T1004_CdcSrv][T1004][Y0-0000000000000000-0-0] [lt=23] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2024-06-24 16:58:43.011053] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [1331][T1004_CdcSrv][T1004][Y0-0000000000000000-0-0] [lt=22] finish to resize log external storage handler(current_ts=1719219523011051, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:43.012095] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523011041000, start_id=1719219523011041000, end_id=1719219523011041001) [2024-06-24 16:58:43.025788] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169E30-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.028420] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE507-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.032736] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE509-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.034983] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE50A-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.035912] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:43.035938] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:43.035977] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=348808919, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:43.037257] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE50B-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.046620] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 311.00) [2024-06-24 16:58:43.046660] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:43.046758] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 363.00) [2024-06-24 16:58:43.046774] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:43.046806] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046825] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046840] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046854] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046886] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046898] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046912] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046926] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046939] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046953] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046968] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046979] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.046993] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.047009] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.047023] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:43.055095] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:43.057191] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE513-0-0] [lt=97][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.057680] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.059754] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE514-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.063579] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE516-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.064742] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219523063797000, start_id=1719219523063797000, end_id=1719219523063797001) [2024-06-24 16:58:43.066247] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:43.066340] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:43.066499] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:43.066552] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:43.066696] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:43.066758] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:43.066929] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE519-0-0] [lt=99][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:43.076552] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:43.076589] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:43.076617] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:43.076666] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:43.076973] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=340, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:43.077009] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:43.077027] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:43.077051] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=401, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:43.077066] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=22, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:43.077194] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE51A-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.077224] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=372, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:43.077258] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:43.077274] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:43.077285] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=436, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:43.077297] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=19, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:43.082132] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.096398] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=852, mem_used=2079744) [2024-06-24 16:58:43.096437] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.096538] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.096876] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.096961] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097059] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097189] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097187] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097192] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097234] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097238] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097241] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097240] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097248] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097262] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097340] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097417] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097515] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097675] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.097821] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098018] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098014] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098023] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098027] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098113] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098367] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098369] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098371] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098379] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098410] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098414] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098660] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098678] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098673] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098669] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098684] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.098696] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.099520] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.111275] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE527-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.113713] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE528-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.124918] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=49] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2024-06-24 16:58:43.126038] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219523125104000, start_id=1719219523125104000, end_id=1719219523125104001) [2024-06-24 16:58:43.126886] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=32] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2024-06-24 16:58:43.126916] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1001) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=27] no transfer partition job [2024-06-24 16:58:43.126935] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1031) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=15] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer={value_str:"True"}) [2024-06-24 16:58:43.130608] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=20] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2024-06-24 16:58:43.130676] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:482) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=53] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2024-06-24 16:58:43.134191] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2024-06-24 16:58:43.134277] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34E-0-0] [lt=26] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1719213346325391, last_statistic_bg_stat_time=1719215758515812, last_statistic_schema_version=1719215719009064, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2024-06-24 16:58:43.134357] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:43.152920] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219523152611000, start_id=1719219523152611000, end_id=1719219523152611001) [2024-06-24 16:58:43.157739] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.158485] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DF-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:43.158520] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8DF-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:43.159710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C92E8-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.159973] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FA-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:43.160011] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FA-0-0] [lt=35] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:43.169175] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:43.169509] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=16, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:43.169533] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:43.169559] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=435, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:43.169574] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:43.172361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:43.175637] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=24] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:43.182211] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:43.182238] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:43.182257] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.190186] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523189608000, start_id=1719219523189608000, end_id=1719219523189608001) [2024-06-24 16:58:43.194029] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] success to update min reserved snapshot(reserved_snapshot=1719217717123751000, duration=1800, snapshot_gc_ts=1719219517123751000) [2024-06-24 16:58:43.194431] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=32442566, this={dio_aligned_buf:{buf_write_offset:2358, buf_padding_size:1738, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:83757, truncate_used_ts:21020}, log_block_size:67108864, dir_fd:671, io_fd:673}, aligned_buf_len=4096, aligned_block_offset=32440320, buf_len=112, total_write_size_=13230, total_write_size_after_dio_=405504, ob_pwrite_used_ts=51201, count=96, each_pwrite_cost=533) [2024-06-24 16:58:43.194961] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=47955961, this={dio_aligned_buf:{buf_write_offset:105, buf_padding_size:3991, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:320710, truncate_used_ts:35032}, log_block_size:67108864, dir_fd:675, io_fd:677}, aligned_buf_len=8192, aligned_block_offset=47951872, buf_len=112, total_write_size_=62213, total_write_size_after_dio_=663552, ob_pwrite_used_ts=63861, count=146, each_pwrite_cost=437) [2024-06-24 16:58:43.195057] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=17] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1719217717123751000) [2024-06-24 16:58:43.195075] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=16] update reserved snapshot finished(cost_ts=1050, reserved_snapshot=1719217717123751000) [2024-06-24 16:58:43.201769] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:43.205372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283440148480, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:43.212046] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219523211823000, start_id=1719219523211823000, end_id=1719219523211823001) [2024-06-24 16:58:43.212593] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:43.241992] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:43.242027] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:43.242344] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:43.242364] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=350, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:43.242374] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=8] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=26, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:43.257800] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.263527] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=6] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:43.263561] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=30] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:43.263580] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=16] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:43.263597] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:43.264883] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219523264699000, start_id=1719219523264699000, end_id=1719219523264699001) [2024-06-24 16:58:43.271202] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854 [2024-06-24 16:58:43.273067] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1861] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:43.276633] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:43.276657] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] try gc retain ctx [2024-06-24 16:58:43.276688] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] get_max_applied_scn(scn={val:1719219522852802004, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32438582}, palf_committed_end_scn_:{val:1719219522852802004, v:0}, last_check_scn_:{val:1719219522852802004, v:0}, max_applied_cb_scn_:{val:1719219522852802004, v:0}}) [2024-06-24 16:58:43.276722] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:43.279052] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=107] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219520547630000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:43.281429] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=102] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219520547630000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:43.282226] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.291933] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=14] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:43.292054] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=57] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:43.292083] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=27] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:43.292158] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1596088320, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5920104448, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:43.292298] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=37] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:43.292319] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=416716, drift_size_=0, pre_drift_size=24480448, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:43.292387] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:43.292467] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:43.292486] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=18] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:43.292556] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:43.292708] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:43.292728] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:43.299406] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE572-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.301196] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2024-06-24 16:58:43.301224] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:43.301253] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=70338178, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:43.301865] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE573-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.306477] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE575-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.308941] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE576-0-0] [lt=110][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.312083] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1169FC4-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.326213] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523325945000, start_id=1719219523325945000, end_id=1719219523325945001) [2024-06-24 16:58:43.326291] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3412, avg_group_log_size=379) [2024-06-24 16:58:43.326316] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3412) [2024-06-24 16:58:43.326469] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112051, mem_used=264127488) [2024-06-24 16:58:43.326584] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3412) [2024-06-24 16:58:43.326613] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3412) [2024-06-24 16:58:43.327849] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=28] ====== tenant freeze timer task ====== [2024-06-24 16:58:43.331071] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AB-0-0] [lt=53][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:43.331100] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AB-0-0] [lt=27][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:43.331086] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=30] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:43.333429] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5844-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219523333340000, start_id=1719219523333340000, end_id=1719219523333340001) [2024-06-24 16:58:43.333970] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19FE37-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219523333340000, start_id=1719219523333340001, end_id=1719219523333340002) [2024-06-24 16:58:43.335407] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041DB0-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.338072] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE57E-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.339706] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97ED9-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219523339691000, start_id=1719219523339691000, end_id=1719219523339691001) [2024-06-24 16:58:43.341976] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE580-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.343345] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=29] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:43.344988] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:43.345098] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:43.345307] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:43.345371] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:43.345538] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:43.345614] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:43.345732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE0-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:43.353017] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219523352372000, start_id=1719219523352372000, end_id=1719219523352372001) [2024-06-24 16:58:43.353866] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219523353429000, start_id=1719219523353429000, end_id=1719219523353429001) [2024-06-24 16:58:43.353912] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=451, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:43.353938] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:43.356111] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EE1-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4565, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.357859] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.369277] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:43.369312] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:43.372433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:43.376714] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=86] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1201, avg_group_log_size=120) [2024-06-24 16:58:43.376729] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1201) [2024-06-24 16:58:43.377118] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1201) [2024-06-24 16:58:43.382242] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.390274] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219523389374000, start_id=1719219523389374000, end_id=1719219523389374001) [2024-06-24 16:58:43.392615] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=47] LogLoopThread round_cost_time(us)(round_cost_time=12) [2024-06-24 16:58:43.397240] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EEE-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.398831] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1719217716793682000, duration=1800, snapshot_gc_ts=1719219516793682000) [2024-06-24 16:58:43.399281] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=45085956, this={dio_aligned_buf:{buf_write_offset:1396, buf_padding_size:2700, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:88106, truncate_used_ts:22726}, log_block_size:67108864, dir_fd:686, io_fd:688}, aligned_buf_len=4096, aligned_block_offset=45084672, buf_len=112, total_write_size_=13719, total_write_size_after_dio_=425984, ob_pwrite_used_ts=39465, count=100, each_pwrite_cost=394) [2024-06-24 16:58:43.399491] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97EEF-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.399921] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=57985647, this={dio_aligned_buf:{buf_write_offset:2783, buf_padding_size:1313, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:102403, truncate_used_ts:26514}, log_block_size:67108864, dir_fd:690, io_fd:692}, aligned_buf_len=4096, aligned_block_offset=57982976, buf_len=112, total_write_size_=12172, total_write_size_after_dio_=421888, ob_pwrite_used_ts=37658, count=100, each_pwrite_cost=376) [2024-06-24 16:58:43.400036] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=21] update reserved snapshot finished(cost_ts=1208, reserved_snapshot=1719217716793682000) [2024-06-24 16:58:43.405870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283444342784, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:43.412279] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219523411537000, start_id=1719219523411537000, end_id=1719219523411537001) [2024-06-24 16:58:43.412353] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:43.412391] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:43.412767] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=373, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:43.412806] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:43.412819] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=3, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:43.412836] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=426, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:43.412843] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=12, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:43.420939] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=129781, mem_used=326519808) [2024-06-24 16:58:43.439132] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F02-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.446923] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:43.449094] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:43.449136] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=41] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:43.449181] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=38] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:43.449333] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=26] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219520849350000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:43.449462] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=122] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:43.449517] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=47] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:43.449539] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219517342441001, v:0}) [2024-06-24 16:58:43.449553] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:43.449575] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:43.449606] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:43.449638] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=30] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:43.451756] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:43.451785] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=28] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:43.451817] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=29] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:43.452063] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=21] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219520849350000, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:43.452169] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=102] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:43.452190] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:43.452211] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:43.452231] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:43.452251] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:43.452265] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:43.457919] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.458501] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=7] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:43.458527] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=22] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:43.458552] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=22] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:43.458569] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:43.464536] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=11] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:43.464874] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=334] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:43.464948] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523464373000, start_id=1719219523464373000, end_id=1719219523464373001) [2024-06-24 16:58:43.465505] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219522852802004, v:0}, new_max_version={val:1719219522852802004, v:0}, last_min_version={val:1719219522852802001, v:0}, last_max_version={val:1719219522852802001, v:0}, total_time_us=2482, delta_us=612702) [2024-06-24 16:58:43.465539] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219522852802004, v:0}, min_version={val:1719219522852802004, v:0}, max_version={val:1719219522852802004, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:43.471748] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=21] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:43.471763] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try gc retain ctx [2024-06-24 16:58:43.471781] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=6] get_max_applied_scn(scn={val:1719219523411537000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70339358}, palf_committed_end_scn_:{val:1719219523464373000, v:0}, last_check_scn_:{val:1719219523464373000, v:0}, max_applied_cb_scn_:{val:1719219523411537000, v:0}}) [2024-06-24 16:58:43.471804] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=21] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:43.473143] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=67] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:43.477231] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=416, avg_log_submit_to_slide_time=425) [2024-06-24 16:58:43.481361] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:43.482256] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.526430] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219523525605000, start_id=1719219523525605000, end_id=1719219523525605001) [2024-06-24 16:58:43.526824] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=295, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:43.526840] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=11, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:43.548710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F3C-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.550575] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F3D-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.553124] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523552922000, start_id=1719219523552922000, end_id=1719219523552922001) [2024-06-24 16:58:43.554187] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F3F-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.556031] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F40-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.557918] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F41-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.557976] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=34][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.572165] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8373) [2024-06-24 16:58:43.572411] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB54-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103419663781, cache_obj->added_lc()=false, cache_obj->get_object_id()=9366, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:43.572507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:43.575239] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F47-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.576833] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=7] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=7159, avg_group_log_size=477) [2024-06-24 16:58:43.576847] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7159) [2024-06-24 16:58:43.577156] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F48-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.580121] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.582314] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.582640] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:43.582706] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:43.582816] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:43.582856] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:43.582941] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:43.582985] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:43.583039] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F4C-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:43.586931] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:153) [841][T1001_COMMONLSS][T1001][YB42AC141156-00061B9D92A0D8C3-0-0] [lt=35][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2024-06-24 16:58:43.590215] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523589930000, start_id=1719219523589930000, end_id=1719219523589930001) [2024-06-24 16:58:43.594479] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19FFD0-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.602173] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A586A-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219523601576000, start_id=1719219523601576000, end_id=1719219523601576001) [2024-06-24 16:58:43.606359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283431759872, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:43.611590] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219523611586, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-06-24 16:58:43.612374] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219523612182000, start_id=1719219523612182000, end_id=1719219523612182001) [2024-06-24 16:58:43.612463] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=7840, avg_group_log_size=461) [2024-06-24 16:58:43.612488] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8373) [2024-06-24 16:58:43.612955] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=6] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7840) [2024-06-24 16:58:43.612974] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=405, avg_log_submit_to_slide_time=410) [2024-06-24 16:58:43.612986] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=218] get number(ret=0, service_type_=0, range=1, base_id=1719219523612182000, start_id=1719219523612182001, end_id=1719219523612182002) [2024-06-24 16:58:43.613265] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13744, offset=3452130}, end_cursor:ObLogCursor{file_id=1, log_id=13745, offset=3452403}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ccc050, len:798, log_data_len:273, seq:13744, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:43.616213] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D912-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219523615372000, start_id=1719219523615372000, end_id=1719219523615372001) [2024-06-24 16:58:43.616768] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] [APPLY STAT CB APPEND COST TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=30, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:43.616797] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=27] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=541, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:43.616816] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:43.616832] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=-513, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:43.616847] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB TOTAL TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=59, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:43.617312] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=46] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13745, offset=3452403}, end_cursor:ObLogCursor{file_id=1, log_id=13746, offset=3452668}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cd8050, len:525, log_data_len:265, seq:13745, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:43.620998] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=16] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:43.621267] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:43.658036] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.665089] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219523665024000, start_id=1719219523665024000, end_id=1719219523665024001) [2024-06-24 16:58:43.669035] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=13] Garbage Collector is running(seq_=618, gc_interval=10000000) [2024-06-24 16:58:43.669124] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=35] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:43.669148] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=19] self is leader, skip it(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:43.669174] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=101) [2024-06-24 16:58:43.669193] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:43.669862] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=374, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:43.669859] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1332) [2024-06-24 16:58:43.669894] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:43.669923] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:43.669949] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=453, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:43.669971] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:43.670000] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=409, avg_log_submit_to_slide_time=419) [2024-06-24 16:58:43.671162] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=15] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:43.672931] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=31] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:43.672964] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=28] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:43.672988] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=22] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:43.673004] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=16] execute_gc cost time(ret=0, time_us=41) [2024-06-24 16:58:43.673018] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2024-06-24 16:58:43.675216] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F5B-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.682374] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.685183] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F5C-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.691190] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074612-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219523690295000, start_id=1719219523690295000, end_id=1719219523690295001) [2024-06-24 16:58:43.691679] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7783) [2024-06-24 16:58:43.691732] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=7783) [2024-06-24 16:58:43.691766] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=399, avg_log_submit_to_slide_time=407) [2024-06-24 16:58:43.700263] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:43.703918] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1AF-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219523702989000, start_id=1719219523702989000, end_id=1719219523702989001) [2024-06-24 16:58:43.721271] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [162333][Blacklist][T0][Y0-0000000000000000-0-0] [lt=23] blacklist_loop exec finished(cost_time=47, is_enabled=true, send_cnt=0) [2024-06-24 16:58:43.722769] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:43.722794] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:43.722855] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=14] cannot_recycle_log_size statistics(cannot_recycle_log_size=103064367, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:43.726013] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=17] ====== tenant freeze timer task ====== [2024-06-24 16:58:43.726281] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219523726253000, start_id=1719219523726253000, end_id=1719219523726253001) [2024-06-24 16:58:43.730591] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=19] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:43.732326] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1302][T1004_TenantMet][T1004][Y0-0000000000000000-0-0] [lt=57] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:4044, free_obj_hold_cnt:74, allocator used:16373168, allocator total:16875264}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:204, free_obj_hold_cnt:8, allocator used:13905292, allocator total:13905292}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():218240, full allocator used:1600, full allocator total:283776}, tablets_mem=31064332, tablets_mem_limit=3092376440, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:135, free_obj_hold_cnt:14, allocator used:305152, allocator total:327040}, pending_cnt=0, wait_gc_count=0, tablet count=4248) [2024-06-24 16:58:43.734196] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A58EA-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219523733617000, start_id=1719219523733617001, end_id=1719219523733617002) [2024-06-24 16:58:43.735248] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD0C1-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219523734636000, start_id=1719219523734636000, end_id=1719219523734636001) [2024-06-24 16:58:43.740125] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE59B-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219523739874000, start_id=1719219523739874000, end_id=1719219523739874001) [2024-06-24 16:58:43.741147] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1CA-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=3, len=87, pos=60, bitmap=NULL) [2024-06-24 16:58:43.752247] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D4-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:43.752492] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D4-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:43.752719] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97F71-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.753248] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E1388A-0-0] [lt=31] adaptive update(Tenant ID=1003, Config Specify Resource Limit(MB)=819, TxShare Current Memory Limit(MB)=668, Holding Memory(MB)=49, Tenant Remain Memory(MB)=1032, Usable Remain Memory(MB)=619, Last Update Limit Timestamp=1719219523752565, Is Updated=true) [2024-06-24 16:58:43.753492] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219523752565000, start_id=1719219523752565000, end_id=1719219523752565001) [2024-06-24 16:58:43.753566] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:43.753601] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:43.754321] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=326, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:43.754340] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=10, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:43.754368] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:43.754386] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=380, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:43.754402] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:43.758095] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=30][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.761638] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D9-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:43.761783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D9-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:43.762043] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D9-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:43.762269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D9-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:43.762421] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A1D9-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:43.762665] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=14999, mem_used=97747968) [2024-06-24 16:58:43.769960] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1332) [2024-06-24 16:58:43.769978] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1332) [2024-06-24 16:58:43.770026] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=33, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:43.770054] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=26] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=404, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:43.770066] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=12] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:43.770080] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-597, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:43.770094] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB TOTAL TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-160, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:43.772579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:43.782434] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.785018] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=17] new mysql sessid created(conn.sessid_=3221494476, support_ssl=false) [2024-06-24 16:58:43.785093] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=33] sm conn init succ(conn.sessid_=3221494476, sess.client_addr_="172.20.17.86:49522") [2024-06-24 16:58:43.785118] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494476, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:43.785210] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494476, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:43.785242] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494476, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:43.785259] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494476, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:43.785287] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=26] mark session id unused(conn.sessid_=3221494476) [2024-06-24 16:58:43.785301] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162512][sql_nio22][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494476, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:43.790545] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219523789595000, start_id=1719219523789595000, end_id=1719219523789595001) [2024-06-24 16:58:43.806899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283440148480, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:43.812570] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219523811774000, start_id=1719219523811774000, end_id=1719219523811774001) [2024-06-24 16:58:43.826149] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=32, mem_used=49913856) [2024-06-24 16:58:43.826190] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=29] release old cannot free more memory [2024-06-24 16:58:43.826207] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=60, size_used=0, mem_used=49913856) [2024-06-24 16:58:43.842713] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=329, avg_log_submit_to_slide_time=342) [2024-06-24 16:58:43.854758] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219523854029000, start_id=1719219523854029000, end_id=1719219523854029001) [2024-06-24 16:58:43.857386] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=18] current monitor number(seq_=-1) [2024-06-24 16:58:43.857407] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A2E3-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:43.857546] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A2E3-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:43.858153] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.858638] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A59A9-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219523858255000, start_id=1719219523858255000, end_id=1719219523858255001) [2024-06-24 16:58:43.861020] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041DEB-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:43.865351] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219523864593000, start_id=1719219523864593000, end_id=1719219523864593001) [2024-06-24 16:58:43.865683] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9355-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219523865630000, start_id=1719219523865630000, end_id=1719219523865630001) [2024-06-24 16:58:43.873048] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FAC-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.873192] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.873314] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.873561] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.873642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.873643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.873957] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874009] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874057] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874062] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874128] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874297] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874331] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874362] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874421] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874556] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874561] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874614] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=8] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=8] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.874805] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:43.875133] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FAD-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.878458] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE66A-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219523878301000, start_id=1719219523878301000, end_id=1719219523878301001) [2024-06-24 16:58:43.879010] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FAF-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.881059] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FB1-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.882494] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.883179] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FB3-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:43.900133] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FBE-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:43.902262] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FBF-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.904466] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:43.904704] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:43.904789] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:43.904869] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:43.905011] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:43.905246] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:43.905334] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:43.905410] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:43.905634] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:43.905715] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:43.905845] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:43.905913] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:43.906102] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:43.906172] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:43.906238] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:43.906339] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:43.906506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:43.906574] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:43.906608] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [728][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B511CD2-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.906649] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:43.906714] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:43.906831] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:43.906897] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:43.907042] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:43.907112] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107469C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:43.909124] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:43.909194] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:43.909313] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:43.909353] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:43.909450] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:43.909496] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:43.909557] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:43.911829] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:43.919337] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FC3-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:43.926323] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219523925767000, start_id=1719219523925767000, end_id=1719219523925767001) [2024-06-24 16:58:43.930469] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10746AD-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219523929990000, start_id=1719219523929990000, end_id=1719219523929990001) [2024-06-24 16:58:43.948210] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FD0-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:43.950348] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FD1-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:43.953311] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E1388B-0-0] [lt=14] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336774077415466309e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.885603957301398736e+01) [2024-06-24 16:58:43.953553] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=53] get number(ret=0, service_type_=0, range=1, base_id=1719219523953179000, start_id=1719219523953179000, end_id=1719219523953179001) [2024-06-24 16:58:43.953656] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7761, avg_group_log_size=646) [2024-06-24 16:58:43.953685] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7761) [2024-06-24 16:58:43.953993] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7761) [2024-06-24 16:58:43.954033] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7761) [2024-06-24 16:58:43.954065] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=17, avg_log_submit_to_flush_time=360, avg_log_submit_to_slide_time=371) [2024-06-24 16:58:43.958211] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.965325] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=14] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16497, offset=3758875}, end_cursor:ObLogCursor{file_id=1, log_id=16498, offset=3759148}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cd4050, len:1253, log_data_len:273, seq:16497, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:43.967938] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9385-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219523967924000, start_id=1719219523967924000, end_id=1719219523967924001) [2024-06-24 16:58:43.968965] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D903-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219523967924000, start_id=1719219523967924000, end_id=1719219523967924001) [2024-06-24 16:58:43.969676] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:43.969715] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2024-06-24 16:58:43.969741] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1332) [2024-06-24 16:58:43.969763] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:43.969801] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2024-06-24 16:58:43.969982] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16498, offset=3759148}, end_cursor:ObLogCursor{file_id=1, log_id=16499, offset=3759413}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cd0050, len:980, log_data_len:265, seq:16498, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:43.970212] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=367, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:43.970231] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1332) [2024-06-24 16:58:43.970260] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=457, avg_log_submit_to_slide_time=464) [2024-06-24 16:58:43.977439] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1323) [2024-06-24 16:58:43.978080] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82400000, replace_num=100000) [2024-06-24 16:58:43.978097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:43.981931] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1719219523981928, bytes: 170878952, bw: 0.018589 MB/s, add_ts: 1007620, add_bytes: 19640 [2024-06-24 16:58:43.982553] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:43.987637] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=42] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:43.989724] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB97FE5-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:43.990608] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219523989971000, start_id=1719219523989971000, end_id=1719219523989971001) [2024-06-24 16:58:44.003133] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:44.004252] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=24] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261355921408) [2024-06-24 16:58:44.007441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283433857024, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:44.012672] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219524012143000, start_id=1719219524012143000, end_id=1719219524012143001) [2024-06-24 16:58:44.038528] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107474C-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219524037505000, start_id=1719219524037505000, end_id=1719219524037505001) [2024-06-24 16:58:44.048904] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 407.00) [2024-06-24 16:58:44.048934] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:44.049030] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 409.50) [2024-06-24 16:58:44.049047] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:44.049080] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049116] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049134] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049148] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049162] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049177] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049205] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049219] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049233] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049244] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049275] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049289] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.049303] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:44.055233] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:44.058269] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.065337] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219524064950000, start_id=1719219524064950000, end_id=1719219524064950001) [2024-06-24 16:58:44.070187] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257405-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219524069175000, start_id=1719219524069175000, end_id=1719219524069175001) [2024-06-24 16:58:44.082613] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.095971] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096114] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096543] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=887, mem_used=2079744) [2024-06-24 16:58:44.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096653] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096664] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096675] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096682] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096684] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096866] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096944] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096960] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096996] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097001] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.096997] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097032] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097225] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097227] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097290] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097293] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097442] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097652] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097659] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097700] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097714] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097716] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097722] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097775] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097817] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097887] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097906] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.097910] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098023] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098026] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098142] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098177] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098312] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098344] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098402] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098450] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098465] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098540] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=6] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098637] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098639] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098639] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098688] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098693] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098695] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098706] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.098791] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.111766] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98021-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:44.111932] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:44.111961] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:44.111993] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=73589521, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:44.113954] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98022-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:44.114564] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163029][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD21-0-0] [lt=37] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:44.114604] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163029][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD21-0-0] [lt=29] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=49) [2024-06-24 16:58:44.117828] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98024-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:44.119849] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98025-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:44.121927] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98026-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:44.126746] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219524126199000, start_id=1719219524126199000, end_id=1719219524126199001) [2024-06-24 16:58:44.133466] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=49] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:44.134467] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:44.139237] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98030-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:44.141353] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98031-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:44.144557] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98033-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:44.147001] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:44.147069] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:44.147187] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:44.147230] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:44.147326] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:44.147371] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:44.147431] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98035-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:44.153569] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219524152594000, start_id=1719219524152594000, end_id=1719219524152594001) [2024-06-24 16:58:44.158330] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.158976] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98036-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:44.160534] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E0-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:44.160570] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E0-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:44.161901] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FB-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:44.161935] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FB-0-0] [lt=30] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:44.169837] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1332) [2024-06-24 16:58:44.170229] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=17, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:44.170262] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:44.170285] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=442, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:44.170301] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=21, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:44.175723] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=18] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:44.177182] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:44.177221] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:44.177251] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:44.177273] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:44.177603] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=357, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:44.177607] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=372, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:44.177638] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:44.177669] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:44.177676] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:44.177692] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=412, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:44.177707] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=31, stat_interval=1000000, avg (count/cost)=18, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:44.177733] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:44.177746] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=439, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:44.177761] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=21, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:44.178139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:44.182635] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.186663] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98046-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:44.188674] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98047-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:44.190736] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219524190602000, start_id=1719219524190602000, end_id=1719219524190602001) [2024-06-24 16:58:44.201829] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:44.207997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283429662720, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:44.212904] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219524212769000, start_id=1719219524212769000, end_id=1719219524212769001) [2024-06-24 16:58:44.224958] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9805B-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:44.241716] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=21] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:44.242565] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:44.242609] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:44.243033] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:44.243054] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=389, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:44.243066] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=27, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:44.258389] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.265435] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219524264579000, start_id=1719219524264579000, end_id=1719219524264579001) [2024-06-24 16:58:44.280768] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=24] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:44.280799] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=30] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:44.280797] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C728-0-0] [lt=14] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:44.280827] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C728-0-0] [lt=26] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:44.282696] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.326591] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:171) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] Eliminate task evict sql audit(request_manager_->get_tenant_id()=1, queue_size=10000000, config_mem_limit_=547608330, request_manager_->get_size_used()=112068, evict_high_size_level=9000000, evict_low_size_level=8000000, allocator->allocated()=264127488, evict_high_mem_level=438086664, evict_low_mem_level=328564998) [2024-06-24 16:58:44.326643] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=49] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112068, mem_used=264127488) [2024-06-24 16:58:44.326674] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219524325797000, start_id=1719219524325797000, end_id=1719219524325797001) [2024-06-24 16:58:44.327160] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=5] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3413) [2024-06-24 16:58:44.327215] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3413) [2024-06-24 16:58:44.342493] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AC-0-0] [lt=52][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:44.342522] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AC-0-0] [lt=27][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:44.343447] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:44.353699] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219524353254000, start_id=1719219524353254000, end_id=1719219524353254001) [2024-06-24 16:58:44.355513] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219524355373000, start_id=1719219524355373000, end_id=1719219524355373001) [2024-06-24 16:58:44.355554] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:44.355957] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219524355935], gts:1719219524355373000, latest_srr:[mts=1719219524355935]}) [2024-06-24 16:58:44.358452] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.360986] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074855-0-0] [lt=19] refresh tenant config success(tenant_id=1002, *this={last_refresh_ts:1719219524360630, can_tenant_elr:true}) [2024-06-24 16:58:44.369974] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:44.370013] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:44.377739] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1098) [2024-06-24 16:58:44.378225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:44.382761] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.390904] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219524390229000, start_id=1719219524390229000, end_id=1719219524390229001) [2024-06-24 16:58:44.392177] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [162299][AutoLSLocRpc][T0][YB42AC141156-00061B9D89F0D959-0-0] [lt=102] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["172.20.17.86:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1003, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1004, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1004, ls_id:{id:1001}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}]) [2024-06-24 16:58:44.408538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283427565568, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:44.412910] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219524412392000, start_id=1719219524412392000, end_id=1719219524412392001) [2024-06-24 16:58:44.412988] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:44.413026] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:44.413423] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=375, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:44.413455] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:44.413479] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=4, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:44.413503] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=427, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:44.413519] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:44.413597] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:44.421069] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129789, mem_used=326519808) [2024-06-24 16:58:44.436981] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:44.439179] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:44.439225] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=44] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:44.439272] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:44.439415] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:44.439550] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=130] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:44.439581] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:44.439604] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219521210793001, v:0}) [2024-06-24 16:58:44.439618] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:44.439643] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:44.439663] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:44.439695] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:44.439721] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:44.439735] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:44.441079] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98099-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:44.444102] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9809A-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:44.449639] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9809C-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:44.452454] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9809D-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:44.455325] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9809E-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:44.458512] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.464255] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:44.465643] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219524465110000, start_id=1719219524465110000, end_id=1719219524465110001) [2024-06-24 16:58:44.466316] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1719219524069175000, v:0}, new_max_version={val:1719219524069175000, v:0}, last_min_version={val:1719219523974245000, v:0}, last_max_version={val:1719219523974245000, v:0}, total_time_us=2706, delta_us=397140) [2024-06-24 16:58:44.466352] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1719219524069175000, v:0}, min_version={val:1719219524069175000, v:0}, max_version={val:1719219524069175000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:44.477379] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:44.477417] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:44.477847] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=454, avg_log_submit_to_slide_time=465) [2024-06-24 16:58:44.477863] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9D9AB97EDD-0-0] [lt=35] [APPLY STAT CB APPEND COST TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=35, this=0x7f4753d24280, extra_info="") [2024-06-24 16:58:44.477886] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9D9AB97EDD-0-0] [lt=22] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=531, this=0x7f4753d244b0, extra_info="") [2024-06-24 16:58:44.477898] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9D9AB97EDD-0-0] [lt=11] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=0, this=0x7f4753d246e0, extra_info="") [2024-06-24 16:58:44.477909] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9D9AB97EDD-0-0] [lt=10] [APPLY STAT CB EXECUTE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=-487, this=0x7f4753d24910, extra_info="") [2024-06-24 16:58:44.477923] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9D9AB97EDD-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=79, this=0x7f4753d24b40, extra_info="") [2024-06-24 16:58:44.479616] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980A7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:44.481472] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:44.482544] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980A8-0-0] [lt=41][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:44.482820] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.486873] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980AA-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:44.489826] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:44.489928] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:44.490122] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:44.490177] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:44.490327] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:44.490393] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:44.490484] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5DEA-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:44.502708] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980AC-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:44.527097] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219524526305000, start_id=1719219524526305000, end_id=1719219524526305001) [2024-06-24 16:58:44.527185] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3998, avg_group_log_size=399) [2024-06-24 16:58:44.527218] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3998) [2024-06-24 16:58:44.527597] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=352, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:44.527649] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=13, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:44.534631] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [1559][T1003_TenantMet][T1003][Y0-0000000000000000-0-0] [lt=33] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:853, free_obj_hold_cnt:60, allocator used:3630088, allocator total:3793664}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:60, free_obj_hold_cnt:5, allocator used:4263415, allocator total:4263415}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():166656, full allocator used:1600, full allocator total:232192}, tablets_mem=8289271, tablets_mem_limit=343597380, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:9, free_obj_hold_cnt:51, allocator used:122880, allocator total:130816}, pending_cnt=0, wait_gc_count=0, tablet count=913) [2024-06-24 16:58:44.539423] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1192][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=47] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:44.539697] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [162298][AutoLSLoc][T1003][YB42AC141156-00061B9D8A40C5C7-0-0] [lt=36][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1748, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:44.540468] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=24] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:44.540495] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980B9-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:44.543256] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980BA-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:44.548180] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=13] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:44.549971] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:44.550078] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516701057000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:44.553860] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219524553719000, start_id=1719219524553719000, end_id=1719219524553719001) [2024-06-24 16:58:44.555323] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=50] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:44.558576] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.572824] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8260) [2024-06-24 16:58:44.577213] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB55-0-0] [lt=32][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103420668584, cache_obj->added_lc()=false, cache_obj->get_object_id()=9367, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:44.577460] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=26, avg_log_batch_cnt=1, total_group_log_size=18221, avg_group_log_size=700) [2024-06-24 16:58:44.577495] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=18221) [2024-06-24 16:58:44.578320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:44.582877] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.583644] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE72C-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219524583240000, start_id=1719219524583240000, end_id=1719219524583240001) [2024-06-24 16:58:44.589573] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5EB0-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219524588516000, start_id=1719219524588516000, end_id=1719219524588516001) [2024-06-24 16:58:44.589981] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219524589572000, start_id=1719219524589572000, end_id=1719219524589572001) [2024-06-24 16:58:44.593914] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB980CF-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:44.606035] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:44.606167] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=131] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:44.606187] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=17] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:44.606262] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=75] get_replay_process success(id={id:1001}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:44.606318] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=11] dump tenant replay process(tenant_id=1002, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:44.608149] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:44.609068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283429662720, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:44.613089] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219524612740000, start_id=1719219524612740000, end_id=1719219524612740001) [2024-06-24 16:58:44.613175] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8260, avg_group_log_size=516) [2024-06-24 16:58:44.613203] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8260) [2024-06-24 16:58:44.613409] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1296][T1004_TntTransf][T1004][YB42AC141156-00061B9D9800C34D-0-0] [lt=25] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:44.613574] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8260) [2024-06-24 16:58:44.613617] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1293][T1004_TntTransf][T1004][YB42AC141156-00061B9D97D0C34D-0-0] [lt=34] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:44.613649] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=412, avg_log_submit_to_slide_time=420) [2024-06-24 16:58:44.619199] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1719219524619196, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-06-24 16:58:44.621107] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:44.621149] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=30] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13746, offset=3452668}, end_cursor:ObLogCursor{file_id=1, log_id=13747, offset=3452941}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cdc050, len:4356, log_data_len:273, seq:13746, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:44.621330] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:44.624074] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D913-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219524623272000, start_id=1719219524623272000, end_id=1719219524623272001) [2024-06-24 16:58:44.625158] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=35] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13747, offset=3452941}, end_cursor:ObLogCursor{file_id=1, log_id=13748, offset=3453206}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ce0050, len:4083, log_data_len:265, seq:13747, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:44.627834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [162982][T1_SSTableGC][T1][YB42AC141156-00061B9D8AB0C1B5-0-0] [lt=22] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217716806320000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217706800618000) [2024-06-24 16:58:44.634362] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [163828][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:44.634487] WDIAG read_multi_row (ob_table_access_helper.h:238) [163828][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:44.634881] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:221) [163828][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:44.639311] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:124) [162982][T1_SSTableGC][T1][YB42AC141156-00061B9D8AB0C1B5-0-0] [lt=40] SSTableGCTask(cost_ts=12302) [2024-06-24 16:58:44.642020] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B19FFFF-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:44.643995] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041E45-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219524643269000, start_id=1719219524643269000, end_id=1719219524643269001) [2024-06-24 16:58:44.658644] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.665706] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219524665369000, start_id=1719219524665369000, end_id=1719219524665369001) [2024-06-24 16:58:44.670538] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=406, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:44.670543] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:44.670574] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:44.670598] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:44.670647] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=487, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:44.670683] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:44.670714] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=498, avg_log_submit_to_slide_time=507) [2024-06-24 16:58:44.682939] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.686654] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1294][T1004_TntTransf][T1004][YB42AC141156-00061B9D97E0C34D-0-0] [lt=35] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:44.698667] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD55-0-0] [lt=24] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:44.699307] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=34] LogLoopThread round_cost_time(us)(round_cost_time=24) [2024-06-24 16:58:44.700328] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=32] gc stale ls task succ [2024-06-24 16:58:44.708046] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A5F7A-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219524707598000, start_id=1719219524707598000, end_id=1719219524707598001) [2024-06-24 16:58:44.708530] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=24548) [2024-06-24 16:58:44.708594] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=24548) [2024-06-24 16:58:44.708643] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=35, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=403, avg_log_submit_to_slide_time=413) [2024-06-24 16:58:44.716736] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=39] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:44.716786] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=33] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1240) [2024-06-24 16:58:44.727223] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219524726614000, start_id=1719219524726614000, end_id=1719219524726614001) [2024-06-24 16:58:44.730303] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1295][T1004_TntTransf][T1004][YB42AC141156-00061B9D97F0C34D-0-0] [lt=34] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:44.730636] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=21] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:44.735412] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10749E9-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:44.754046] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219524753054000, start_id=1719219524753054000, end_id=1719219524753054001) [2024-06-24 16:58:44.754141] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:44.754185] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:44.754577] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=328, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:44.754617] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:44.754685] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=8, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:44.754714] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=393, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:44.754730] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=28, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:44.758636] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.762789] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=19124, mem_used=110226432) [2024-06-24 16:58:44.765866] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98109-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:44.768769] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9810A-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:44.768780] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [163826][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=35] report RowHolderMapper summary info(count=2620, bkt_cnt=7851) [2024-06-24 16:58:44.770645] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:44.770671] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:44.770716] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=34] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:44.770753] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=19] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:44.770777] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=18] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:44.770791] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=13] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1219) [2024-06-24 16:58:44.774185] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9810C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:44.777027] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9810D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:44.778409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:44.779905] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9810E-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:44.782998] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.784838] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=31] new mysql sessid created(conn.sessid_=3221494477, support_ssl=false) [2024-06-24 16:58:44.784898] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=20] sm conn init succ(conn.sessid_=3221494477, sess.client_addr_="172.20.17.86:49524") [2024-06-24 16:58:44.784920] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494477, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:44.784983] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494477, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:44.785015] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494477, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:44.785034] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494477, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:44.785058] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494477) [2024-06-24 16:58:44.785071] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162494][sql_nio4][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494477, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:44.790047] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219524790035000, start_id=1719219524790035000, end_id=1719219524790035001) [2024-06-24 16:58:44.799382] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:68133, max_lsn:45083680, max_scn:{val:1719219524355373004, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:45083680}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:3140640}}, last_submit_lsn:{lsn:45083558}, last_submit_end_lsn:{lsn:45083680}, last_submit_log_id:68133, last_submit_log_pid:1, max_flushed_lsn:{lsn:45083558}, max_flushed_end_lsn:{lsn:45083680}, max_flushed_log_pid:1, committed_end_lsn:{lsn:45083680}, last_slide_log_id:68133, last_slide_scn:{val:1719219524355373004, v:0}, last_slide_lsn:{lsn:45083558}, last_slide_end_lsn:{lsn:45083680}, last_slide_log_pid:1, last_slide_log_accum_checksum:317649142, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d7a46530}, [StateMgr]={this:0x7f46d7a4a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:68134, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213363223619, palf_role_change_cb:0x7f46d7a50cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d7a47c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1/meta", dir_fd:685, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d7a4c478, flashback_version:0}, log_storage:{log_tail:{lsn:45083680}, readable_log_tail:{lsn:45083680}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1/log", dir_fd:686, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:22021088, block_header_serialize_buf_:0x7f46d7a4e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213363223315, this:0x7f46d7a4a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213363224198, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d7a4a430}) [2024-06-24 16:58:44.799567] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=182] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219524770720, last_flushed_end_lsn:{lsn:45083680}}]) [2024-06-24 16:58:44.799579] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=10] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=68134, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219524770720, last_flushed_end_lsn:{lsn:45083680}}]) [2024-06-24 16:58:44.803274] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A6023-0-0] [lt=34][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:44.804971] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98116-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:44.807893] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98117-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:44.809609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283425468416, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:44.811892] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=11] ====== check clog disk timer task ====== [2024-06-24 16:58:44.811919] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:44.811971] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=39] cannot_recycle_log_size statistics(cannot_recycle_log_size=53491381, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:44.812546] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811A-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:44.813214] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219524812247000, start_id=1719219524812247000, end_id=1719219524812247001) [2024-06-24 16:58:44.815977] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:44.816078] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:44.816263] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:44.816318] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:44.816466] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:44.816537] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:44.816643] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:44.826350] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=33, mem_used=49913856) [2024-06-24 16:58:44.826395] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=35] release old cannot free more memory [2024-06-24 16:58:44.826416] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=69, size_used=0, mem_used=49913856) [2024-06-24 16:58:44.829036] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9811D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:44.843399] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=421, avg_log_submit_to_slide_time=435) [2024-06-24 16:58:44.854701] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=11] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:44.854774] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=72] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:44.854804] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=7] dump tenant replay process(tenant_id=1001, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:44.856290] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219524855611000, start_id=1719219524855611000, end_id=1719219524855611001) [2024-06-24 16:58:44.856325] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=30] ts response task statistics(alloc_count=248562, free_count=124280) [2024-06-24 16:58:44.856350] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=13] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219524856282], gts:1719219524855611000, latest_srr:[mts=1719219524856282]}) [2024-06-24 16:58:44.856386] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219524856373], gts:1719219524855611000, latest_srr:[mts=1719219524856373]}) [2024-06-24 16:58:44.856414] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219524856402], gts:1719219524855611000, latest_srr:[mts=1719219524856402]}) [2024-06-24 16:58:44.856440] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219524856428], gts:1719219524855611000, latest_srr:[mts=1719219524856428]}) [2024-06-24 16:58:44.858698] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.865822] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219524865128000, start_id=1719219524865128000, end_id=1719219524865128001) [2024-06-24 16:58:44.866474] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] get_max_applied_scn(scn={val:1719219524721326000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:517714595}, palf_committed_end_scn_:{val:1719219524721326000, v:0}, last_check_scn_:{val:1719219524721326000, v:0}, max_applied_cb_scn_:{val:1719219524721326000, v:0}}) [2024-06-24 16:58:44.871212] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9812B-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:44.873564] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873576] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873741] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873783] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873946] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.873998] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874170] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874249] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874253] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874256] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874261] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874433] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9812C-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:44.874439] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874455] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874462] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874467] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874536] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874533] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874552] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874636] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.874709] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:44.883055] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.911890] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:44.927250] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219524926404000, start_id=1719219524926404000, end_id=1719219524926404001) [2024-06-24 16:58:44.928174] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9813F-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:44.935762] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=34] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:44.952030] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [940][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:44.952156] WDIAG read_multi_row (ob_table_access_helper.h:238) [940][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=35][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:44.953924] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E13890-0-0] [lt=15] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336774077415466309e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.885603957301398736e+01) [2024-06-24 16:58:44.954205] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1719219524953861000, start_id=1719219524953861000, end_id=1719219524953861001) [2024-06-24 16:58:44.954293] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:44.954320] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7764) [2024-06-24 16:58:44.954723] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:44.954813] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7764) [2024-06-24 16:58:44.954868] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=380, avg_log_submit_to_slide_time=394) [2024-06-24 16:58:44.958778] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.959213] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=16] ====== tenant freeze timer task ====== [2024-06-24 16:58:44.970368] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:44.970413] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=35] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:44.970437] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:44.970458] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:44.970491] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:44.970809] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=416, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:44.970829] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:44.970873] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=13, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=435, avg_log_submit_to_slide_time=446) [2024-06-24 16:58:44.973650] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16499, offset=3759413}, end_cursor:ObLogCursor{file_id=1, log_id=16500, offset=3759686}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ce4050, len:715, log_data_len:273, seq:16499, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:44.977811] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:463) [1215][T1004_TeRec][T1004][YB42AC141156-00061B9D9330D904-0-0] [lt=34] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1719219523855085000, v:0}, new_replayable_scn={val:1719219523855085000, v:0}, new_readable_scn={val:1719219523855085000, v:0}, old_tenant_info={tenant_id:1004, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719219522852802000, v:0}, replayable_scn:{val:1719219522852802000, v:0}, standby_scn:{val:1719219522852802000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1001}}) [2024-06-24 16:58:44.978299] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D904-0-0] [lt=59] get number(ret=0, service_type_=0, range=1, base_id=1719219524978193000, start_id=1719219524978193000, end_id=1719219524978193001) [2024-06-24 16:58:44.978506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:44.979386] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=46] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16500, offset=3759686}, end_cursor:ObLogCursor{file_id=1, log_id=16501, offset=3759951}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9ce8050, len:442, log_data_len:265, seq:16500, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:44.983114] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:44.989546] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1719219524989544, bytes: 170900007, bw: 0.019928 MB/s, add_ts: 1007616, add_bytes: 21055 [2024-06-24 16:58:44.991291] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219524990862000, start_id=1719219524990862000, end_id=1719219524990862001) [2024-06-24 16:58:45.003225] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:45.010160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283425468416, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:45.011504] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:45.011542] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=25] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1240) [2024-06-24 16:58:45.013297] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219525013079000, start_id=1719219525013079000, end_id=1719219525013079001) [2024-06-24 16:58:45.025590] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [917][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=18] dump dtl interm result cost(us)(dump_cost=6, ret=0, interm count=0, dump count=620) [2024-06-24 16:58:45.025635] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [917][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=30] clear dtl interm result cost(us)(clear_cost=3, ret=0, gc_.expire_keys_.count()=0, dump count=620, interm count=0, clean count=0) [2024-06-24 16:58:45.033534] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=17918014, clean_num=201326) [2024-06-24 16:58:45.036062] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:45.036093] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:45.036131] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348841060, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:45.043952] INFO [STORAGE.BLKMGR] mark_and_sweep (ob_block_manager.cpp:1008) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=23] no block alloc/free, no need to mark blocks(ret=0, mark_info.count()=0) [2024-06-24 16:58:45.043983] INFO [STORAGE.BLKMGR] mark_and_sweep (ob_block_manager.cpp:1037) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=26] finish once mark and sweep(ret=0, alloc_num=11139, mark_info.count()=0, marker_status={total_block_count:424448, reserved_block_count:2, linked_block_count:0, tmp_file_count:0, data_block_count:167, shared_data_block_count:25, index_block_count:2, ids_block_count:0, disk_block_count:0, bloomfiter_count:0, hold_count:251, pending_free_count:0, free_count:424195, shared_meta_block_count:57, mark_cost_time:1120, sweep_cost_time:0, start_time:"2024-06-24 16:58:45.42858", last_end_time:"2024-06-24 16:58:45.43980", hold_info:nothing}, map_cnt=251) [2024-06-24 16:58:45.051152] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 429.00) [2024-06-24 16:58:45.051179] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:45.051272] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 375.00) [2024-06-24 16:58:45.051287] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:45.051323] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051343] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051357] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051371] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051385] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051400] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051414] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051427] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051443] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051458] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051471] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051489] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051500] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051514] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051528] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.051541] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:45.055396] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=30] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:45.058829] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.065919] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1719219525064867000, start_id=1719219525064867000, end_id=1719219525064867001) [2024-06-24 16:58:45.070395] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] tx gc loop thread is running(MTL_ID()=1004) [2024-06-24 16:58:45.070416] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] try gc retain ctx [2024-06-24 16:58:45.070448] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] get_max_applied_scn(scn={val:1719219524856668001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:45083924}, palf_committed_end_scn_:{val:1719219524856668001, v:0}, last_check_scn_:{val:1719219524856668001, v:0}, max_applied_cb_scn_:{val:1719219524856668001, v:0}}) [2024-06-24 16:58:45.070481] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:45.072967] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=98] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219522852802000, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:45.073909] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=22] LogLoopThread round_cost_time(us)(round_cost_time=23) [2024-06-24 16:58:45.075325] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=98] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219522852802000, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:45.078100] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:45.083174] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.087419] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98179-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:45.090504] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9817A-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:45.095977] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9817C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:45.096419] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096452] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096649] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096696] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=927, mem_used=2079744) [2024-06-24 16:58:45.096729] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096728] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096732] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096921] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.096999] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097020] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097120] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097120] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097119] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097176] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097278] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097435] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097467] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097542] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097603] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097634] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.097770] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098047] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098252] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098344] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098345] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098410] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098411] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098514] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098593] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098595] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098663] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098671] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098820] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098877] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.098904] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9817D-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:45.098968] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.101929] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9817E-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:45.117782] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=12] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:45.117825] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=22] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:45.117853] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=25] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:45.117890] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=34] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1232) [2024-06-24 16:58:45.126863] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98186-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:45.127144] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [162968][T1_TenantWeakRe][T1][YB42AC141156-00061B9D89B13975-0-0] [lt=30] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=204) [2024-06-24 16:58:45.127361] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219525127237000, start_id=1719219525127237000, end_id=1719219525127237001) [2024-06-24 16:58:45.129734] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98187-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:45.134166] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98189-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:45.134582] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:45.137114] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:45.137222] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:45.137408] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:45.137471] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:45.137639] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:45.137714] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:45.137819] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818B-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:45.150904] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9818C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:45.154101] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219525153661000, start_id=1719219525153661000, end_id=1719219525153661001) [2024-06-24 16:58:45.158890] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.162137] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219525162115000, start_id=1719219525162115000, end_id=1719219525162115001) [2024-06-24 16:58:45.162355] WDIAG [STORAGE.TRANS] check_double_insert_ (ob_mvcc_row.cpp:930) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=27][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f46b84f2180 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:82030} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1719215152848208 type=0 flag=0 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:4}, prev=this=0x7f4733963c58 trans_version={val:1719219515158452000, v:0} scn={val:1719219515158452000, v:0} tx_id={txid:81910} prev=0x7f4733963b08 next=(nil) modify_count=873 acc_checksum=1135808604 version=1719215152848208 type=0 flag=12 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:7}, snapshot_version={val:1719219525162115000, v:0}, *this={this=0x7f47339376b0 latch_=locked flag=11 first_dml=DELETE last_dml=INSERT update_since_compact=4 list_head=0x7f4733963c58 latest_compact_node=0x7f46b77ea5d8 max_trans_version={val:1719219515158452000, v:0} max_trans_id=81910 max_elr_trans_version={val:1719219515158452000, v:0} max_elr_trans_id=81910 latest_compact_ts=1719219495072405 last_compact_cnt=869 total_trans_node_cnt=874 max_modify_scn={val:1719219515158452000, v:0} min_modify_scn={val:1719215152848421000, v:0}}) [2024-06-24 16:58:45.162432] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:972) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=75][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f46b84f2180 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:82030} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1719215152848208 type=0 flag=0 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:4}, ctx={this:0x7f4765e4ee80, ls_id:{id:1001}, ls:0x7f47366f8150, branch:0, timeout:1719219535062003, tablet_id:{id:200142}, table_iter:0x7f4765e4e150, table_version:1719213404545896, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1719219535062003, tx_lock_timeout_us:-1, snapshot:{version:{val:1719219525162115000, v:0}, tx_id:{txid:82030}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f4736706990, epoch:1, mini_cache_:}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:82030}, tx_desc:{this:0x7f47a209eb30, tx_id:{txid:82030}, state:1, addr:"172.20.17.86:2882", tenant_id:1002, session_id:3221487744, assoc_session_id:3221487744, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1719219525161058, active_ts:1719219525162115, commit_ts:-1, finish_ts:-1, timeout_us:86400000000, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1719213093, cluster_version:17180066048, seq_base:1719219525096596, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:true, cflict_txs:[], abort_cause:0, commit_expire_ts:-1, commit_task_.is_registered():false, ref:2}, tx_ctx:0x7f47a7cb1050, mem_ctx:0x7f47a7cb25d0, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false}) [2024-06-24 16:58:45.162571] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:339) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=138][errcode=-5024] mvcc write failed(ret=-5024, mem_ctx={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:82030} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}, arg={tx_id:{txid:82030}, data:0x7f4765e4b238, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1719215152848208, seq_no:{branch:0, seq:4}, scn:{val:4611686018427387903, v:0}, column_cnt:8}) [2024-06-24 16:58:45.162620] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:323) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=47][errcode=0] primary key duplication conflict(key={"VARCHAR":"172.20.17.86:5433", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:82030} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2024-06-24 16:58:45.162686] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:3838) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=63][errcode=-5024] fail to set memtable(ret=-5024) [2024-06-24 16:58:45.162714] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E1-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:45.162749] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E1-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:45.162704] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5375) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=14][errcode=-5024] failed to write table row(ret=-5024, table id=500310, col_descs=[cnt:8, column_id=16 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=17 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=18 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=19 {type:"TINYINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"TINYINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"DATETIME", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"DATETIME", collation:"binary", coercibility:"NUMERIC"} order=0], tbl_row={flag:"INSERT", flag_type:0} capacity_=0 is_get=0 from_base=0 trans_id=8217090173679840641 scan_index=0 multi_version_row_flag=0 {first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0} row_val={count=8,cells=[{"VARCHAR":"172.20.17.86:5433", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"VARCHAR":"7513a2bb6f", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"VARCHAR":"265c81f5a4bed7cc05ac37c8bcf81170d86650be6b28644a344f4f45f2dd7aa7", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"TINYINT":1},{"TINYINT":0},{"VARCHAR":"4.3.0-20240617185317", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"DATETIME":"2024-06-24 16:58:45.000000"},{"DATETIME":"2024-06-24 16:58:45.000000"},] is_sparse_row=0 snapshot_version=0 fast_filtered=0 group_idx_=0 last_purge_ts=0 ) [2024-06-24 16:58:45.162820] INFO [STORAGE] print_count (ob_query_iterator_factory.cpp:50) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=85] ObQueryIteratorFactory statistics(multi_scan_merge_alloc_count=0, multi_scan_merge_release_count=0, multi_get_merge_alloc_count=0, multi_get_merge_release_count=0, table_scan_alloc_count=0, table_scan_release_count=0, insert_dup_alloc_count=8921, insert_dup_release_count=8921, col_map_alloc_count=0, col_map_release_count=0) [2024-06-24 16:58:45.162858] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:2923) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=23][errcode=-5024] failed to write row(ret=-5024) [2024-06-24 16:58:45.162914] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:851) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A62AA-0-0] [lt=13] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:82030} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-06-24 16:58:45.163860] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FC-0-0] [lt=27] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:45.163894] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FC-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:45.167080] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041E7B-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219525166340000, start_id=1719219525166340000, end_id=1719219525166340001) [2024-06-24 16:58:45.170519] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=79] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1211) [2024-06-24 16:58:45.170963] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:45.170999] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:45.171027] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=507, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:45.171046] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:45.175814] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=51] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:45.177787] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:45.177825] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:45.178205] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=456, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:45.178240] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=17, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:45.178263] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:45.178289] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=545, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:45.178306] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=27, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:45.178592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:45.183235] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.184717] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D42E-0-0] [lt=22] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:45.190948] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219525190641000, start_id=1719219525190641000, end_id=1719219525190641001) [2024-06-24 16:58:45.194224] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98199-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:45.196946] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9819A-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:45.201890] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=30] gc stale ls task succ [2024-06-24 16:58:45.213380] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219525212780000, start_id=1719219525212780000, end_id=1719219525212780001) [2024-06-24 16:58:45.229176] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D47E-0-0] [lt=8] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:45.229885] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [803][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=49] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:45.230678] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [939][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=34] report RowHolderMapper summary info(count=2620, bkt_cnt=7836) [2024-06-24 16:58:45.234052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283419176960, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:45.237521] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=15] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:45.239310] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=36] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:45.239409] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=27] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516793682000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:45.239445] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:651) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=33] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1719219516793682000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1004, freeze_info:{latest_snapshot_gc_scn:{val:1719219516793682000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}}) [2024-06-24 16:58:45.241674] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=11] ====== checkpoint timer task ====== [2024-06-24 16:58:45.241727] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=24] get_max_applied_scn(scn={val:1719219525153661000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:73598462}, palf_committed_end_scn_:{val:1719219525190641000, v:0}, last_check_scn_:{val:1719219525190641000, v:0}, max_applied_cb_scn_:{val:1719219525153661000, v:0}}) [2024-06-24 16:58:45.241763] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=33] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:45.243155] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:45.243177] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:45.243589] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:45.243612] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=458, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:45.243645] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=34, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:45.243934] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=87] succ to get rec scn(*this={this:0x7f46f0604030, ls_id:{id:1}, tenant_id:1003, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216321111181000, v:0}, last_push_gc_task_ts_:1719216953731290, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:45.243965] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=31] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46f1df0080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216953736744, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46f1df0080, snapshot_version:{val:1719216953736744, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:45.244005] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=33] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:45.244155] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:45.244260] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=100] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46f1d8d790}, min_rec_scn={val:1719216953754927000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:45.244288] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:45.244308] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=0, rec_log_ts={val:1719219517910315001, v:0}) [2024-06-24 16:58:45.244321] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:45.244340] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:45.244367] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216953754927000, v:0}, checkpoint_scn_in_ls_meta={val:1719216953754927000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:45.244395] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:45.244417] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:45.244429] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=10] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:45.244747] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981AE-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:45.253336] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:45.253362] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=17] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:45.253385] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1239) [2024-06-24 16:58:45.258948] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.266031] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219525265548000, start_id=1719219525265548000, end_id=1719219525265548001) [2024-06-24 16:58:45.277858] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:45.277887] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:45.277904] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=108] tx gc loop thread is running(MTL_ID()=1003) [2024-06-24 16:58:45.277934] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=28] try gc retain ctx [2024-06-24 16:58:45.278207] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=372, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:45.278240] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:45.278253] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:45.278276] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=438, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:45.278292] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=22, stat_interval=1000000, avg (count/cost)=21, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:45.280244] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1003, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:45.283294] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.290703] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=16] dump dtl interm result cost(us)(dump_cost=3720, ret=0, interm count=0, dump count=617) [2024-06-24 16:58:45.293774] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=34] clear dtl interm result cost(us)(clear_cost=3036, ret=0, gc_.expire_keys_.count()=0, dump count=617, interm count=0, clean count=0) [2024-06-24 16:58:45.301337] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:45.301362] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:45.301405] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=30] cannot_recycle_log_size statistics(cannot_recycle_log_size=70354813, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:45.306164] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [348][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=8] ====== traversal_flush timer task ====== [2024-06-24 16:58:45.306359] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BC-0-0] [lt=25] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219522351687002, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:45.306548] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BC-0-0] [lt=123] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219522351687002, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:45.306666] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BC-0-0] [lt=115] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:45.326753] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112103, mem_used=264127488) [2024-06-24 16:58:45.327470] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219525326745000, start_id=1719219525326745000, end_id=1719219525326745001) [2024-06-24 16:58:45.327956] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3412) [2024-06-24 16:58:45.328006] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3412) [2024-06-24 16:58:45.328923] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:45.332116] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:397) [162151][ServerTracerTim][T0][YB42AC141156-00061B9D86E0C5CC-0-0] [lt=19] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-06-24 16:58:45.333290] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074C73-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219525333089000, start_id=1719219525333089000, end_id=1719219525333089001) [2024-06-24 16:58:45.333943] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A63EC-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219525333089000, start_id=1719219525333089001, end_id=1719219525333089002) [2024-06-24 16:58:45.336922] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=28] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:45.341130] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041E92-0-0] [lt=100] get number(ret=0, service_type_=0, range=1, base_id=1719219525340497000, start_id=1719219525340497000, end_id=1719219525340497001) [2024-06-24 16:58:45.343549] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:45.354032] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AD-0-0] [lt=49][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:45.354067] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AD-0-0] [lt=33][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:45.354089] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219525353159000, start_id=1719219525353159000, end_id=1719219525353159001) [2024-06-24 16:58:45.354774] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] [WRS] update tenant weak read server version(tenant_id=1003, server_version={version:{val:1719219525190641000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1719219525354744}, version_delta=164132) [2024-06-24 16:58:45.357177] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219525356328000, start_id=1719219525356328000, end_id=1719219525356328001) [2024-06-24 16:58:45.357216] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:45.359008] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.370681] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:45.370719] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:45.376051] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [960][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:45.376221] INFO [MDS] flush (mds_table_mgr.cpp:172) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BC-0-0] [lt=22] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:45.376356] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BC-0-0] [lt=129] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:45.378641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:45.383352] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.390990] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219525390085000, start_id=1719219525390085000, end_id=1719219525390085001) [2024-06-24 16:58:45.395859] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981E8-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:45.398558] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981E9-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:45.403657] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [162977][T1_ArcSender][T1][YB42AC141156-00061B9D8760C0E5-0-0] [lt=29][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:45.404115] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981EA-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:45.406253] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D444-0-0] [lt=47] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:45.406803] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981EB-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:45.409600] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981EC-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:45.413506] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219525413326000, start_id=1719219525413326000, end_id=1719219525413326001) [2024-06-24 16:58:45.413583] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:45.413618] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:45.413992] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=376, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:45.414028] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:45.414064] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=9, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:45.414094] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=440, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:45.414113] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=29, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:45.421241] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=39] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129805, mem_used=326519808) [2024-06-24 16:58:45.430499] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2024-06-24 16:58:45.432440] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219525432320000, start_id=1719219525432320000, end_id=1719219525432320001) [2024-06-24 16:58:45.432881] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=3254731, this={dio_aligned_buf:{buf_write_offset:3053, buf_padding_size:1043, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:115070, truncate_used_ts:30495}, log_block_size:67108864, dir_fd:667, io_fd:668}, aligned_buf_len=4096, aligned_block_offset=3252224, buf_len=546, total_write_size_=84938, total_write_size_after_dio_=753664, ob_pwrite_used_ts=64944, count=164, each_pwrite_cost=396) [2024-06-24 16:58:45.433197] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074CE1-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:45.434066] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=37] run rewrite rule refresh task(rule_mgr_->tenant_id_=1003) [2024-06-24 16:58:45.434568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283421274112, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:45.435941] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981F7-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:45.436120] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219525435491000, start_id=1719219525435491000, end_id=1719219525435491001) [2024-06-24 16:58:45.436567] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=37] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=6499081, this={dio_aligned_buf:{buf_write_offset:3371, buf_padding_size:725, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:132542, truncate_used_ts:33085}, log_block_size:67108864, dir_fd:682, io_fd:683}, aligned_buf_len=4096, aligned_block_offset=6496256, buf_len=546, total_write_size_=81028, total_write_size_after_dio_=606208, ob_pwrite_used_ts=45478, count=129, each_pwrite_cost=352) [2024-06-24 16:58:45.440068] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981F9-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:45.442720] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:45.442819] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:45.442993] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:45.443051] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:45.443197] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:45.443266] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:45.443358] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FB-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:45.455171] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB981FC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:45.459070] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.463772] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1364][T1004_LCLSender][T1004][Y0-0000000000000000-0-0] [lt=48] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47231fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:45.466208] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219525466112000, start_id=1719219525466112000, end_id=1719219525466112001) [2024-06-24 16:58:45.466658] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1004) [2024-06-24 16:58:45.468827] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219525468228000, start_id=1719219525468228000, end_id=1719219525468228001) [2024-06-24 16:58:45.477966] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:45.477994] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:45.478390] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:45.480741] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=9] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:45.481616] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:45.482524] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=36] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:45.482640] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516741149000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:45.483413] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.496051] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9820B-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:45.496922] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2024-06-24 16:58:45.498761] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9820C-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:45.499299] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219525498882000, start_id=1719219525498882000, end_id=1719219525498882001) [2024-06-24 16:58:45.499797] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=14, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=453, avg_log_submit_to_slide_time=461) [2024-06-24 16:58:45.517720] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E93B-0-0] [lt=29] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1719219525517701}) [2024-06-24 16:58:45.517745] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D068-0-0] [lt=28] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:45.518123] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D068-0-0] [lt=26] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219525518093, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:45.518162] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D068-0-0] [lt=37] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1719219525517701}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219525518093, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:45.519917] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E93B-0-0] [lt=31] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:45.520078] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E93B-0-0] [lt=30][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:45.525599] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1719219525326745000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198850, in_cluster_service=true, cluster_version={val:1719219525127237000, v:0}, min_cluster_version={val:1719219525127237000, v:0}, max_cluster_version={val:1719219525127237000, v:0}, get_cluster_version_err=0, cluster_version_delta=398358, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60567, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219313404268000, v:0}, local_cluster_delta=212121327, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:45.526554] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219525526270000, start_id=1719219525526270000, end_id=1719219525526270001) [2024-06-24 16:58:45.527098] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162936][T1_ApplySrv0][T1][YB42AC141156-00061B9D8820FB52-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219525526270000, start_id=1719219525526270001, end_id=1719219525526270002) [2024-06-24 16:58:45.527190] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219525326745000, v:0}, new_max_version={val:1719219525326745000, v:0}, last_min_version={val:1719219525127237000, v:0}, last_max_version={val:1719219525127237000, v:0}, total_time_us=1546, delta_us=200444) [2024-06-24 16:58:45.527207] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219525326745000, v:0}, min_version={val:1719219525326745000, v:0}, max_version={val:1719219525326745000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:45.527730] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=23] start to print blacklist info [2024-06-24 16:58:45.527921] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=27] ls blacklist refresh finish(cost_time=11912) [2024-06-24 16:58:45.548010] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9821D-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:45.554164] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219525553657000, start_id=1719219525553657000, end_id=1719219525553657001) [2024-06-24 16:58:45.554760] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get wrs ts(ls_id={id:1}, delta=119219, log_service_ts=1719219525435491, min_tx_service_ts=4611686018427387, timestamp={val:1719219525435491000, v:0}) [2024-06-24 16:58:45.554791] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:214) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=26] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1003, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=98, Other_Error_Cnt=0, Submit_Succ_Cnt=2, last_scn="{val:1719219525190641001, v:0}", last_lsn={lsn:73598518}, last_gts={val:1719219525435491000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2024-06-24 16:58:45.559139] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.561707] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-06-24 16:58:45.563607] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219525563138000, start_id=1719219525563138000, end_id=1719219525563138001) [2024-06-24 16:58:45.563706] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3957, avg_group_log_size=395) [2024-06-24 16:58:45.563738] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3997) [2024-06-24 16:58:45.564064] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=53498182, this={dio_aligned_buf:{buf_write_offset:871, buf_padding_size:3225, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:89918, truncate_used_ts:24226}, log_block_size:67108864, dir_fd:658, io_fd:660}, aligned_buf_len=4096, aligned_block_offset=53497856, buf_len=545, total_write_size_=37399, total_write_size_after_dio_=421888, ob_pwrite_used_ts=36397, count=94, each_pwrite_cost=387) [2024-06-24 16:58:45.564118] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=387, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:45.564144] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:45.564314] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A65B7-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219525564193000, start_id=1719219525564193000, end_id=1719219525564193001) [2024-06-24 16:58:45.570024] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A65BD-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:45.570379] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A65BD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:45.570671] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A65BD-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:45.570959] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A65BD-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:45.571440] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A65BD-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:45.574216] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=33] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:99320, max_lsn:73600888, max_scn:{val:1719219525553657000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:73600888}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:31657848}}, last_submit_lsn:{lsn:73600299}, last_submit_end_lsn:{lsn:73600888}, last_submit_log_id:99320, last_submit_log_pid:1, max_flushed_lsn:{lsn:73600299}, max_flushed_end_lsn:{lsn:73600888}, max_flushed_log_pid:1, committed_end_lsn:{lsn:73600888}, last_slide_log_id:99320, last_slide_scn:{val:1719219525553657000, v:0}, last_slide_lsn:{lsn:73600299}, last_slide_end_lsn:{lsn:73600888}, last_slide_log_pid:1, last_slide_log_accum_checksum:1634000324, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46f1dbc530}, [StateMgr]={this:0x7f46f1dc02b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:99321, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213354015462, palf_role_change_cb:0x7f46f1dc6cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46f1dbdc70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1003/1/meta", dir_fd:681, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46f1dc2478, flashback_version:0}, log_storage:{log_tail:{lsn:73600888}, readable_log_tail:{lsn:73600888}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719218755426586001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1003/1/log", dir_fd:682, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:60608648, block_header_serialize_buf_:0x7f46f1dc4138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213354015379, this:0x7f46f1dc09f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213354015961, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46f1dc0430}) [2024-06-24 16:58:45.574517] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=297] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219525554617, last_flushed_end_lsn:{lsn:73600888}}]) [2024-06-24 16:58:45.574539] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=18] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=99321, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219525554617, last_flushed_end_lsn:{lsn:73600888}}]) [2024-06-24 16:58:45.578730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:45.583475] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.584392] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB56-0-0] [lt=20][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103421675760, cache_obj->added_lc()=false, cache_obj->get_object_id()=9368, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:45.587539] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D42E-0-0] [lt=19] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:45.591115] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219525590524000, start_id=1719219525590524000, end_id=1719219525590524001) [2024-06-24 16:58:45.591149] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=10] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1003) [2024-06-24 16:58:45.591189] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=35] start lib cache evict(tenant_id=1003, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:45.591210] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1003, cache_evict_num=0, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:45.591228] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:45.598897] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=144, alloc_obj_list=[{obj_id:6, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:7, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:182, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:183, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:195, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:196, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195296}, {obj_id:199, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198764}, {obj_id:232, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197576}, {obj_id:237, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:238, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:242, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:246, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:248, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:250, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:251, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:252, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:253, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:254, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:255, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:256, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190960}, {obj_id:257, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:258, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:259, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:265, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:267, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193914}, {obj_id:268, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:269, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:270, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:271, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:273, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245001}, {obj_id:274, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238477}, {obj_id:278, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303661}, {obj_id:280, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250140}, {obj_id:282, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265464}, {obj_id:283, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260287}, {obj_id:285, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:286, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:287, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:288, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:289, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:290, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:291, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:292, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:293, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:294, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:296, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:297, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:298, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:299, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:300, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:302, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:306, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:307, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:308, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:310, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:311, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:313, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:314, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:315, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192384}, {obj_id:316, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:317, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:318, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179373}, {obj_id:319, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:320, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:321, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:322, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214835}, {obj_id:323, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257749}, {obj_id:324, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257679}, {obj_id:325, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:301211}, {obj_id:326, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:322954}, {obj_id:327, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255184}, {obj_id:328, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253823}, {obj_id:329, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:326827}, {obj_id:330, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262876}, {obj_id:331, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283304}, {obj_id:332, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296168}, {obj_id:333, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:261538}, {obj_id:334, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:285869}, {obj_id:335, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300008}, {obj_id:336, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183813}, {obj_id:337, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215145}, {obj_id:338, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252630}, {obj_id:339, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273088}, {obj_id:340, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280836}, {obj_id:341, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275631}, {obj_id:342, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:284691}, {obj_id:343, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250120}, {obj_id:344, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246226}, {obj_id:345, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247565}, {obj_id:346, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242359}, {obj_id:347, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:348, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:349, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:350, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:351, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265421}, {obj_id:352, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269241}, {obj_id:353, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270506}, {obj_id:354, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276928}, {obj_id:355, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267956}, {obj_id:356, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273080}, {obj_id:357, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280749}, {obj_id:358, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292309}, {obj_id:359, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278185}, {obj_id:360, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288460}, {obj_id:361, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288428}, {obj_id:362, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303857}, {obj_id:363, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:364, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:365, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:366, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:367, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:368, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:369, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419863}, {obj_id:371, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312858}, {obj_id:372, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417607}, {obj_id:373, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:374, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:375, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:376, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:377, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:378, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:379, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:380, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:384, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:385, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200158}, {obj_id:386, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332258}, {obj_id:387, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:388, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:434, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187881}, {obj_id:435, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269004}, {obj_id:436, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:437, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:500, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297770}, {obj_id:686, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175750}, {obj_id:687, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189803}, {obj_id:688, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465848}, {obj_id:689, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461380}, {obj_id:690, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:352652}, {obj_id:691, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:850328}, {obj_id:692, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195368}, {obj_id:693, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276678}, {obj_id:694, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:695, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272832}, {obj_id:696, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242168}]) [2024-06-24 16:58:45.599499] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=598] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:45.610677] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] [COMPACTION DAG STATUS] (start_time=1719219515608673, end_time=1719219525610672, dag_status={}) [2024-06-24 16:58:45.610713] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610737] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610755] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610770] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610784] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610798] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610815] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610845] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:45.610859] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610879] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610896] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610931] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610945] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610961] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610977] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.610994] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611011] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611027] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611046] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611062] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611094] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611110] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611126] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611142] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611158] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611209] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611225] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611241] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611257] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611273] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611305] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611340] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611356] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611372] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611388] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611404] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611436] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611454] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611470] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611485] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611501] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611514] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611530] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611577] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=47] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611594] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611610] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611643] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611659] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611675] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611692] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611772] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611804] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611837] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:45.611854] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:45.611868] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:45.611879] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:45.611887] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:45.611901] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:45.611910] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:45.611921] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:45.611933] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:45.611942] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:45.611953] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:45.611967] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:45.613485] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219525612642000, start_id=1719219525612642000, end_id=1719219525612642001) [2024-06-24 16:58:45.613943] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9396) [2024-06-24 16:58:45.613994] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8806) [2024-06-24 16:58:45.614019] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=408, avg_log_submit_to_slide_time=419) [2024-06-24 16:58:45.614167] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:45.621211] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:45.621412] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:45.626820] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1719219525626815, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-06-24 16:58:45.628754] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=22] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13748, offset=3453206}, end_cursor:ObLogCursor{file_id=1, log_id=13749, offset=3453479}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cec050, len:3818, log_data_len:273, seq:13748, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:45.631385] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:463) [163725][T1002_TeRec][T1002][YB42AC141156-00061B9D8CC0D914-0-0] [lt=28] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=237367999, MAX_GAP=900000000000, new_sync_scn={val:1719219524592741000, v:0}, new_replayable_scn={val:1719219524592741000, v:0}, new_readable_scn={val:1719219524355373001, v:0}, old_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719219523601576000, v:0}, replayable_scn:{val:1719219523601576000, v:0}, standby_scn:{val:1719219523353429000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1001}}) [2024-06-24 16:58:45.631708] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D914-0-0] [lt=48] get number(ret=0, service_type_=0, range=1, base_id=1719219525631599000, start_id=1719219525631599000, end_id=1719219525631599001) [2024-06-24 16:58:45.631779] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D914-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=9930, avg_group_log_size=551) [2024-06-24 16:58:45.631800] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D914-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9396) [2024-06-24 16:58:45.632776] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=31] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13749, offset=3453479}, end_cursor:ObLogCursor{file_id=1, log_id=13750, offset=3453744}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cf0050, len:3545, log_data_len:265, seq:13749, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:45.635076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283423371264, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:45.652401] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1003, server_version={version:{val:1719219525435491000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=216903, in_cluster_service=true, cluster_version={val:1719219525353159000, v:0}, min_cluster_version={val:1719219525353159000, v:0}, max_cluster_version={val:1719219525353159000, v:0}, get_cluster_version_err=0, cluster_version_delta=299235, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=59966, succ_cluster_heartbeat_count=9, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219471621660000, v:0}, local_cluster_delta=54030734, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:45.659195] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.666327] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219525666319000, start_id=1719219525666319000, end_id=1719219525666319001) [2024-06-24 16:58:45.671194] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=372, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:45.671195] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1211) [2024-06-24 16:58:45.671231] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:45.671272] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:45.671310] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=464, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:45.671330] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:45.678094] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=25, avg_log_batch_cnt=1, total_group_log_size=13627, avg_group_log_size=545) [2024-06-24 16:58:45.678122] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=13627) [2024-06-24 16:58:45.683533] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.693182] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=22] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2024-06-24 16:58:45.693301] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=30] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=375809635, ret=0) [2024-06-24 16:58:45.693399] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=20] set tenant work area memory(tenant_id=1003, wa_pctg=5, limit=157286400, ret=0) [2024-06-24 16:58:45.693495] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=14] set tenant work area memory(tenant_id=1004, wa_pctg=5, limit=773094110, ret=0) [2024-06-24 16:58:45.700389] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:45.711740] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1719219525466112000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=245621, in_cluster_service=true, cluster_version={val:1719219525413326000, v:0}, min_cluster_version={val:1719219525413326000, v:0}, max_cluster_version={val:1719219525413326000, v:0}, get_cluster_version_err=0, cluster_version_delta=298407, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60255, succ_cluster_heartbeat_count=10, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219444964826000, v:0}, local_cluster_delta=80746907, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:45.718168] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98260-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:45.721347] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98261-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:45.722953] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=14] ====== check clog disk timer task ====== [2024-06-24 16:58:45.722993] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=28] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:45.723028] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=103069653, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:45.726189] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041EAE-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219525725359000, start_id=1719219525725359000, end_id=1719219525725359001) [2024-06-24 16:58:45.726635] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219525726415000, start_id=1719219525726415000, end_id=1719219525726415001) [2024-06-24 16:58:45.726655] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=6676) [2024-06-24 16:58:45.726690] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=6676) [2024-06-24 16:58:45.726730] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=400, avg_log_submit_to_slide_time=411) [2024-06-24 16:58:45.727104] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98263-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:45.727258] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=25] ====== tenant freeze timer task ====== [2024-06-24 16:58:45.729380] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D444-0-0] [lt=22] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:45.730210] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98264-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:45.730720] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=22] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:45.733259] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98265-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:45.735976] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:45.737726] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=30] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:45.737828] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219516806320000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:45.737863] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:651) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1719219516806320000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1, freeze_info:{latest_snapshot_gc_scn:{val:1719219516806320000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}}) [2024-06-24 16:58:45.738064] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=24] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:45.740206] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1074E34-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219525740165000, start_id=1719219525740165000, end_id=1719219525740165001) [2024-06-24 16:58:45.745636] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=13] === Run print tenant memory usage task === [2024-06-24 16:58:45.745739] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=19] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 288,169,984 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 2,043,682,816 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 42,557,440 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 25,780,224 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,719,219,525,745,451 active_memstore_used= 136,314,880 total_memstore_used= 136,314,880 total_memstore_hold= 136,314,880 memstore_freeze_trigger_limit= 1,825,361,100 memstore_limit= 9,126,805,500 mem_tenant_limit= 18,253,611,008 mem_tenant_hold= 1,576,955,904 max_mem_memstore_can_get_now= 14,898,270,208 memstore_alloc_pos= 192,937,984 memstore_frozen_pos= 56,623,104 memstore_reclaimed_pos= 56,623,104 [TENANT_MEMORY] tenant_id= 1,001 now= 1,719,219,525,745,451 active_memstore_used= 46,137,344 total_memstore_used= 46,137,344 total_memstore_hold= 46,137,344 memstore_freeze_trigger_limit= 66,484,200 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 526,340,096 max_mem_memstore_can_get_now= 332,421,094 memstore_alloc_pos= 96,468,992 memstore_frozen_pos= 50,331,648 memstore_reclaimed_pos= 50,331,648 [TENANT_MEMORY] tenant_id= 1,002 now= 1,719,219,525,745,451 active_memstore_used= 421,527,552 total_memstore_used= 421,527,552 total_memstore_hold= 421,527,552 memstore_freeze_trigger_limit= 601,295,400 memstore_limit= 3,006,477,080 mem_tenant_limit= 7,516,192,768 mem_tenant_hold= 1,619,156,992 max_mem_memstore_can_get_now= 4,221,411,328 memstore_alloc_pos= 723,517,440 memstore_frozen_pos= 301,989,888 memstore_reclaimed_pos= 301,989,888 [TENANT_MEMORY] tenant_id= 1,003 now= 1,719,219,525,745,451 active_memstore_used= 46,137,344 total_memstore_used= 46,137,344 total_memstore_hold= 46,137,344 memstore_freeze_trigger_limit= 117,442,300 memstore_limit= 687,194,760 mem_tenant_limit= 1,717,986,918 mem_tenant_hold= 669,392,896 max_mem_memstore_can_get_now= 587,211,544 memstore_alloc_pos= 104,857,600 memstore_frozen_pos= 58,720,256 memstore_reclaimed_pos= 58,720,256 [TENANT_MEMORY] tenant_id= 1,004 now= 1,719,219,525,745,451 active_memstore_used= 199,229,440 total_memstore_used= 199,229,440 total_memstore_hold= 199,229,440 memstore_freeze_trigger_limit= 1,546,188,220 memstore_limit= 7,730,941,100 mem_tenant_limit= 15,461,882,266 mem_tenant_hold= 1,612,541,952 max_mem_memstore_can_get_now= 11,945,126,298 memstore_alloc_pos= 255,852,544 memstore_frozen_pos= 56,623,104 memstore_reclaimed_pos= 56,623,104 [2024-06-24 16:58:45.745944] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=42] [CHUNK_MGR] limit=296,352,743,424 hold= 8,501,202,944 total_hold= 8,826,912,768 used= 8,116,408,320 freelists_hold= 384,794,624 total_maps= 3,049 total_unmaps= 98 large_maps= 195 large_unmaps= 0 huge_maps= 32 huge_unmaps= 8 memalign=0 resident_size= 8,141,520,896 virtual_memory_used= 9,925,324,800 [CHUNK_MGR] 2 MB_CACHE: hold= 266,338,304 free= 127 pushes= 16,169,414 pops= 16,169,287 maps= 2,822 unmaps= 90 [CHUNK_MGR] 4 MB_CACHE: hold= 38,621,184 free= 17 pushes= 11,703 pops= 11,686 maps= 126 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 0 free= 0 pushes= 45 pops= 45 maps= 18 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 10,376 pops= 10,374 maps= 10 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 16,818,176 free= 2 pushes= 12 pops= 10 maps= 29 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 50,393,088 free= 3 pushes= 8 pops= 5 maps= 9 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [2024-06-24 16:58:45.746148] INFO print (ob_malloc_time_monitor.cpp:39) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=15] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 0, 10): delta_total_cost_time= 585529, delta_count= 697522, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10, 100): delta_total_cost_time= 48509, delta_count= 1726, avg_cost_time= 28 [MALLOC_TIME_MONITOR] [ 100, 1000): delta_total_cost_time= 5701, delta_count= 49, avg_cost_time= 116 [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2024-06-24 16:58:45.754468] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1719219525753926000, start_id=1719219525753926000, end_id=1719219525753926001) [2024-06-24 16:58:45.754545] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:45.754586] INFO [LIB] stat (utility.h:1165) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:45.754961] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=365, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:45.754992] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=16, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:45.755014] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:45.755039] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=431, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:45.755054] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=25, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:45.758369] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE74A-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219525758154000, start_id=1719219525758154000, end_id=1719219525758154001) [2024-06-24 16:58:45.758382] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A6726-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219525758154000, start_id=1719219525758154001, end_id=1719219525758154002) [2024-06-24 16:58:45.759242] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.762612] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A6729-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:45.762907] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=22628, mem_used=118545408) [2024-06-24 16:58:45.764848] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=8] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:45.765551] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9826E-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:45.766027] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [971][T1001_MediumLoo][T1001][YB42AC141156-00061B9D9250C24D-0-0] [lt=32] MediumCheckTask(cost_ts=44) [2024-06-24 16:58:45.766606] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:45.766719] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219517123751000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:45.766754] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:651) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1719219517123751000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1002, freeze_info:{latest_snapshot_gc_scn:{val:1719219517123751000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}}) [2024-06-24 16:58:45.769931] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98270-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:45.771372] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1635) [2024-06-24 16:58:45.771399] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1211) [2024-06-24 16:58:45.771451] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=418, avg_log_submit_to_slide_time=434) [2024-06-24 16:58:45.772591] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:45.772721] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:45.772912] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:45.772973] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:45.773124] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:45.773195] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:45.773292] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98272-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:45.778814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:45.783590] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.783695] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98273-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:45.784818] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494478, support_ssl=false) [2024-06-24 16:58:45.784894] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221494478, sess.client_addr_="172.20.17.86:49526") [2024-06-24 16:58:45.784920] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f46bf5f6030, session_id:3221494478, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:45.784984] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46bf5f6030, session_id:3221494478, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:45.785017] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221494478, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:45.785036] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f46bf5f6030, session_id:3221494478, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:45.785061] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=23] mark session id unused(conn.sessid_=3221494478) [2024-06-24 16:58:45.785076] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221494478, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:45.791609] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219525790884000, start_id=1719219525790884000, end_id=1719219525790884001) [2024-06-24 16:58:45.792151] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB APPEND COST TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=35, this=0x7f46f1dd4280, extra_info="") [2024-06-24 16:58:45.792171] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=19] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=392, this=0x7f46f1dd44b0, extra_info="") [2024-06-24 16:58:45.792180] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=9] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=0, this=0x7f46f1dd46e0, extra_info="") [2024-06-24 16:58:45.792188] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=8] [APPLY STAT CB EXECUTE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=-524, this=0x7f46f1dd4910, extra_info="") [2024-06-24 16:58:45.792194] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=6] [APPLY STAT CB TOTAL TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=-96, this=0x7f46f1dd4b40, extra_info="") [2024-06-24 16:58:45.804316] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [403][T1002_MediumLoo][T1002][YB42AC141156-00061B9D9230C24D-0-0] [lt=26] MediumCheckTask(cost_ts=38) [2024-06-24 16:58:45.813809] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1719219525813000000, start_id=1719219525813000000, end_id=1719219525813000001) [2024-06-24 16:58:45.820300] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=20] LogLoopThread round_cost_time(us)(round_cost_time=11) [2024-06-24 16:58:45.821914] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98282-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:45.824729] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98283-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:45.826534] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=20] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=38, mem_used=49913856) [2024-06-24 16:58:45.826587] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=26] release old cannot free more memory [2024-06-24 16:58:45.826605] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=72, size_used=0, mem_used=49913856) [2024-06-24 16:58:45.835584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283417079808, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:45.843949] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=427, avg_log_submit_to_slide_time=439) [2024-06-24 16:58:45.857590] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=20] current monitor number(seq_=-1) [2024-06-24 16:58:45.857956] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219525857149000, start_id=1719219525857149000, end_id=1719219525857149001) [2024-06-24 16:58:45.858010] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] gts statistics(tenant_id=1001, gts_rpc_cnt=11, get_gts_cache_cnt=396, get_gts_with_stc_cnt=61, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=61, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:45.858044] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=8159, get_gts_with_stc_cnt=65, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:45.859301] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:45.859346] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=43] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:45.859365] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.864416] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1719219525498882000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=365526, in_cluster_service=true, cluster_version={val:1719219525340497000, v:0}, min_cluster_version={val:1719219525340497000, v:0}, max_cluster_version={val:1719219525340497000, v:0}, get_cluster_version_err=0, cluster_version_delta=523911, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60182, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219385327519000, v:0}, local_cluster_delta=140536889, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:45.866470] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219525865597000, start_id=1719219525865597000, end_id=1719219525865597001) [2024-06-24 16:58:45.873595] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.873639] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.873650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.873651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.873656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.873660] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.873772] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874043] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874048] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874170] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874275] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874298] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874306] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874333] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874400] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874510] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874530] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874574] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874574] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874596] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874606] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874766] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.874975] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:45.875159] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98297-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:45.883634] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.883848] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [966][T1001_ArcFetche][T1001][YB42AC141156-00061B9D8DA0C0E5-0-0] [lt=25] ObArchiveFetcher is running(thread_index=0) [2024-06-24 16:58:45.889703] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=64] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1004, server_version={version:{val:1719219525468228002, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=421468, in_cluster_service=true, cluster_version={val:1719219525468228001, v:0}, min_cluster_version={val:1719219525468228001, v:0}, max_cluster_version={val:1719219525468228001, v:0}, get_cluster_version_err=0, cluster_version_delta=421468, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60007, succ_cluster_heartbeat_count=6, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219412155330001, v:0}, local_cluster_delta=113734366, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:45.911950] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:45.926737] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219525925742000, start_id=1719219525925742000, end_id=1719219525925742001) [2024-06-24 16:58:45.933413] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [162941][T1_RFLWorker][T1][YB42AC141156-00061B9D8700C0E5-0-0] [lt=44] ObRemoteFetchWorker is running(thread_index=0) [2024-06-24 16:58:45.948490] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1586][T1003_LCLSender][T1003][Y0-0000000000000000-0-0] [lt=34] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47041fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:45.953494] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219525953189000, start_id=1719219525953189000, end_id=1719219525953189001) [2024-06-24 16:58:45.959359] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.971009] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:45.971049] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1635, avg_group_log_size=163) [2024-06-24 16:58:45.971076] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1635) [2024-06-24 16:58:45.971095] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:45.971125] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:45.971446] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1635) [2024-06-24 16:58:45.971493] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=438, avg_log_submit_to_slide_time=450) [2024-06-24 16:58:45.971697] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=381, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:45.978899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:45.983644] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=26] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16501, offset=3759951}, end_cursor:ObLogCursor{file_id=1, log_id=16502, offset=3760224}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cf4050, len:4273, log_data_len:273, seq:16501, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:45.983716] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:45.987892] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D905-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1719219525986885000, start_id=1719219525986885000, end_id=1719219525986885001) [2024-06-24 16:58:45.987987] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D905-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9548, avg_group_log_size=636) [2024-06-24 16:58:45.988016] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D905-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9011) [2024-06-24 16:58:45.988343] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9548) [2024-06-24 16:58:45.988396] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9548) [2024-06-24 16:58:45.988427] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=397, avg_log_submit_to_slide_time=407) [2024-06-24 16:58:45.988990] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16502, offset=3760224}, end_cursor:ObLogCursor{file_id=1, log_id=16503, offset=3760489}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cf8050, len:4000, log_data_len:265, seq:16502, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:45.991773] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1719219525991117000, start_id=1719219525991117001, end_id=1719219525991117002) [2024-06-24 16:58:45.995126] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=30] get_max_applied_scn(scn={val:1719219525858204001, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:57984826}, palf_committed_end_scn_:{val:1719219525858204001, v:0}, last_check_scn_:{val:1719219525858204001, v:0}, max_applied_cb_scn_:{val:1719219525858204001, v:0}}) [2024-06-24 16:58:45.995162] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=33] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213369678630001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:45.997165] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1719219525997162, bytes: 170920102, bw: 0.019019 MB/s, add_ts: 1007618, add_bytes: 20095 [2024-06-24 16:58:46.003276] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=31] gc stale ls task succ [2024-06-24 16:58:46.009605] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:46.009674] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=46] get_max_applied_scn(scn={val:1719219525925742000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:53495922}, palf_committed_end_scn_:{val:1719219525925742000, v:0}, last_check_scn_:{val:1719219525925742000, v:0}, max_applied_cb_scn_:{val:1719219525925742000, v:0}}) [2024-06-24 16:58:46.009711] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:46.011928] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=94] succ to get rec scn(*this={this:0x7f47b3e04030, ls_id:{id:1}, tenant_id:1, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216858758544000, v:0}, last_push_gc_task_ts_:1719216859472314, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1025}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.011969] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=40] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47b6924080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216859475873, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47b6924080, snapshot_version:{val:1719216859475873, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.012010] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:46.012199] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:46.012307] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=103] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f47b684c1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f47b685a0d0, memtable_head:3, memtable_tail:4, t3m:0x7f47ded72030, tables:[null, null, null, 0x7f47b6914080, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215058499657, tx_data_table:0x7f47b685bb90, ls_tablet_svr:0x7f47b684c190}, min_rec_scn={val:1719216859633263000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:46.012357] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:46.012378] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=0, rec_log_ts={val:1719219522058160001, v:0}) [2024-06-24 16:58:46.012392] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.012405] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.012425] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216859633263000, v:0}, checkpoint_scn_in_ls_meta={val:1719216859633263000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:46.012455] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:46.012477] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:46.012492] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:46.013903] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [958][T1001_TenantWea][T1001][YB42AC141156-00061B9D8D7138F8-0-0] [lt=31] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.606133174896240234e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=380, Throttle Trigger(MB)=228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.382848409577892426e+02) [2024-06-24 16:58:46.014188] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219526013309000, start_id=1719219526013309000, end_id=1719219526013309001) [2024-06-24 16:58:46.033138] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982D3-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:46.036024] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982D4-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:46.036123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283417079808, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:46.041279] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982D6-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:46.043594] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=9] tx gc loop thread is running(MTL_ID()=1) [2024-06-24 16:58:46.043608] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=13] try gc retain ctx [2024-06-24 16:58:46.044049] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982D7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:46.044755] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:46.046889] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982D8-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4801, pos=2781, bitmap=NULL) [2024-06-24 16:58:46.048654] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=36] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1719219526048611}) [2024-06-24 16:58:46.048712] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=31] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1719219526048707}) [2024-06-24 16:58:46.048706] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D069-0-0] [lt=31] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219526048678, sql_renew_time:1719219526048678, is_mark_fail:false}]) [2024-06-24 16:58:46.048752] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D069-0-0] [lt=45] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1719219526048611}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219526048678, sql_renew_time:1719219526048678, is_mark_fail:false}]) [2024-06-24 16:58:46.048800] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06A-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219526048791, sql_renew_time:1719219526048791, is_mark_fail:false}]) [2024-06-24 16:58:46.048824] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06A-0-0] [lt=24] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1719219526048707}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219526048791, sql_renew_time:1719219526048791, is_mark_fail:false}]) [2024-06-24 16:58:46.051101] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=20] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1001}) [2024-06-24 16:58:46.051134] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=32] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"META$1002", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.051159] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=25] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.051175] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=16] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.051189] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053494] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 395.50) [2024-06-24 16:58:46.053501] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1}) [2024-06-24 16:58:46.053516] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:46.053558] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=21] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1002}) [2024-06-24 16:58:46.053586] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=19] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1004}) [2024-06-24 16:58:46.053661] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 373.50) [2024-06-24 16:58:46.053672] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1002}) [2024-06-24 16:58:46.053677] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:46.053688] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=15] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"ocp_meta", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053701] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053705] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053714] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053719] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053730] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=16] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053738] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053748] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053756] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=11] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1003}) [2024-06-24 16:58:46.053759] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053769] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053770] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"META$1004", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053783] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053785] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053795] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053796] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053808] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053807] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=11] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053817] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053829] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053828] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=10] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1004}) [2024-06-24 16:58:46.053839] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=11] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"ocp_monitor", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053841] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053853] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053851] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053865] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053864] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.053877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:46.053875] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163031][T1_L0_G0][T1][YB42AC141156-00061B9D9C60C116-0-0] [lt=11] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:46.055537] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=33] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:46.059420] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.066568] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219526066047000, start_id=1719219526066047000, end_id=1719219526066047001) [2024-06-24 16:58:46.067236] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=35] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213342229334001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:46.069558] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC16-0-0] [lt=26][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103422160927, cache_obj->added_lc()=false, cache_obj->get_object_id()=9369, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:46.070412] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E1-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:46.070816] WDIAG get_refactored (ob_hashtable.h:1102) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC17-0-0] [lt=33][errcode=-4201] hashtable not init [2024-06-24 16:58:46.070837] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC17-0-0] [lt=20][errcode=-4016] get cursor info failed(cursor_id=1152, get_sessid()=3221489125) [2024-06-24 16:58:46.070980] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB5A-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219526070274000, start_id=1719219526070274000, end_id=1719219526070274001) [2024-06-24 16:58:46.073261] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E3-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:46.077619] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E4-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:46.078814] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1522) [2024-06-24 16:58:46.080475] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:46.080586] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:46.080806] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:46.080876] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:46.081046] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:46.081125] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:46.081231] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E7-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:46.083767] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.093526] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982E8-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4565, pos=3045, bitmap=NULL) [2024-06-24 16:58:46.096635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.096640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.096650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.096763] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.096859] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.096981] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=965, mem_used=2079744) [2024-06-24 16:58:46.097041] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097060] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097063] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097098] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097120] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097215] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097217] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097355] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097416] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=65] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097470] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097473] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097479] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097482] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097707] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097710] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097818] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097886] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097919] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097926] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097937] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.097948] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098074] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098102] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098387] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098441] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098537] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098547] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098557] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098516] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098614] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098639] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098658] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.098696] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.099019] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.099409] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.099432] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.112090] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:46.112124] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:46.112154] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=14] cannot_recycle_log_size statistics(cannot_recycle_log_size=73605707, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:46.114932] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD22-0-0] [lt=17] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:46.114959] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD22-0-0] [lt=20] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=29) [2024-06-24 16:58:46.126855] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219526126143000, start_id=1719219526126143000, end_id=1719219526126143001) [2024-06-24 16:58:46.127332] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB5A-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=33, this=0x7f47b68f8280, extra_info="") [2024-06-24 16:58:46.127361] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB5A-0-0] [lt=27] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=411, this=0x7f47b68f84b0, extra_info="") [2024-06-24 16:58:46.127377] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB5A-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=0, this=0x7f47b68f86e0, extra_info="") [2024-06-24 16:58:46.127391] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB5A-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=-441, this=0x7f47b68f8910, extra_info="") [2024-06-24 16:58:46.127405] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB5A-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=3, this=0x7f47b68f8b40, extra_info="") [2024-06-24 16:58:46.134677] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:46.134957] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982F5-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:46.138007] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB982F6-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:46.139211] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=26] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:46.142333] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] Garbage Collector is running(seq_=621, gc_interval=10000000) [2024-06-24 16:58:46.142402] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=31] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:46.142432] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=15] gc_check_member_list_ cost time(ret=0, time_us=66) [2024-06-24 16:58:46.142451] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:46.144360] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:46.144398] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=31] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:46.144419] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=23) [2024-06-24 16:58:46.144434] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyHandler start process [2024-06-24 16:58:46.144451] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=15] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2024-06-24 16:58:46.144485] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2024-06-24 16:58:46.153661] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219526153584000, start_id=1719219526153584000, end_id=1719219526153584001) [2024-06-24 16:58:46.159479] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.164740] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E2-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:46.164780] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E2-0-0] [lt=36] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:46.165892] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FD-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:46.165925] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FD-0-0] [lt=30] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:46.171184] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:46.171587] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:46.171573] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:46.171601] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=446, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:46.171609] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=24, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:46.175901] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=19] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:46.178377] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:46.178414] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:46.178838] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=391, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:46.178869] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:46.178892] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:46.178921] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=460, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:46.178944] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=25, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:46.183881] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:46.183909] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:46.183928] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.186255] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:174) [163820][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=49] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2024-06-24 16:58:46.186291] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [163820][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=33] finish to resize log external storage handler(current_ts=1719219526186288, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:46.188508] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82500000, replace_num=100000) [2024-06-24 16:58:46.188531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:46.191563] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=88] get number(ret=0, service_type_=0, range=1, base_id=1719219526190560000, start_id=1719219526190560000, end_id=1719219526190560001) [2024-06-24 16:58:46.195662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98309-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:46.201973] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:46.214151] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219526213821000, start_id=1719219526213821000, end_id=1719219526213821001) [2024-06-24 16:58:46.236669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283419176960, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:46.237261] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [383][T1002_ArcSender][T1002][YB42AC141156-00061B9D8D10C0E5-0-0] [lt=36][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:46.243705] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:46.243730] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:46.244152] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:46.244180] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=436, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:46.244199] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:46.253086] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] [COMPACTION DAG STATUS] (start_time=1719219516251078, end_time=1719219526253082, dag_status={}) [2024-06-24 16:58:46.253125] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253167] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=41] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253199] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253235] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253271] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253296] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253310] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253328] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:46.253342] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253362] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253379] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253393] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253409] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253425] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253442] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253477] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253494] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253510] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253526] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253560] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253576] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253592] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253611] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=39] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253667] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253683] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253700] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253716] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253732] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253748] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253766] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253782] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253799] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253815] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253847] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253863] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253884] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253919] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253964] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253980] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.253996] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254012] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254046] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254062] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254092] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254108] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254124] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254140] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254156] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254174] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254191] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254207] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254224] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254241] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254254] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254309] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:46.254325] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:46.254340] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:46.254357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:46.254368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:46.254382] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:46.254391] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:46.254402] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:46.254411] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:46.254423] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:46.254435] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:46.254449] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:46.259537] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.266721] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=113] get number(ret=0, service_type_=0, range=1, base_id=1719219526266692000, start_id=1719219526266692000, end_id=1719219526266692001) [2024-06-24 16:58:46.278469] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:46.278497] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:46.278873] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=358, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:46.278906] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:46.278986] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=8, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:46.279025] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=449, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:46.279061] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=28, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:46.281348] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:46.281379] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=30] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:46.281374] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C729-0-0] [lt=22] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:46.281399] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C729-0-0] [lt=23] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:46.283898] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.292901] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:46.293113] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=51] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:46.293141] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:46.293208] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=375809638, max_wa_memory_size=375809638, tmp_max_wa_memory_size=375809638, pre_mem_target=373712486, remain_memory_size=375809638, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1617059840, washable_size=-2, max_workarea_memory_size=375809638, max_tenant_memory_size=5899132928, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:46.293282] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46976204, calc_global_bound_size=1048576000000, mem_target_=375809638, wa_max_memory_size=375809638, profile_cnt_=1, total_memory_size=2097152, max_wa_size=375809638, avg_bound_size=375809638, max_bound_size=46976204, min_bound_size_=1048576) [2024-06-24 16:58:46.293301] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=46976204, manual_calc_cnt_=416927, drift_size_=0, pre_drift_size=24480448, wa_max_memory_size=375809638, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=1, pre_profile_cnt=1, calc_info.get_global_bound_size()=46976204, total_memory_size=2097152, cur_profile_cnt=1, calc_info.get_mem_target()=375809638, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:46.293366] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:46.293507] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:46.293526] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=18] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:46.293601] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=19] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:46.293796] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=36] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:46.293814] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=17] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:46.310785] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=8] ====== checkpoint timer task ====== [2024-06-24 16:58:46.312619] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] succ to get rec scn(*this={this:0x7f474be04030, ls_id:{id:1}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215719054755000, v:0}, last_push_gc_task_ts_:1719216936767864, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.312658] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=38] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739404080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216936773978, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739404080, snapshot_version:{val:1719216936773978, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.312698] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=30] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:46.312833] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219523601576000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:46.312932] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=94] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f4753c761b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f4753c840d0, memtable_head:2, memtable_tail:3, t3m:0x7f4782d1e030, tables:[null, null, 0x7f4753dced90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215135780086, tx_data_table:0x7f4753c85b90, ls_tablet_svr:0x7f4753c76190}, min_rec_scn={val:1719216939041208000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:46.312976] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:46.312995] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=0, rec_log_ts={val:1719219519847687001, v:0}) [2024-06-24 16:58:46.313006] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=10] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.313025] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=7] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216939041208000, v:0}, checkpoint_scn_in_ls_meta={val:1719216939041208000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:46.313052] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:46.313072] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:46.314880] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] succ to get rec scn(*this={this:0x7f474beb6030, ls_id:{id:1001}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213748817809002, v:0}, last_push_gc_task_ts_:1719215150704743, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:580}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.314904] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739405350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215150709832, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739405350, snapshot_version:{val:1719215150709832, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:46.314932] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:46.314993] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219523601576000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:46.315071] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=76] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f4736709790}, min_rec_scn={val:1719215150797158000, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:46.315085] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213342229334001, v:0}) [2024-06-24 16:58:46.315102] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215150797158000, v:0}, checkpoint_scn_in_ls_meta={val:1719215150797158000, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:46.315118] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:201314304}, new_base_lsn={lsn:201314304}, lsn={lsn:201314304}) [2024-06-24 16:58:46.315134] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:201314304}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:46.315146] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:46.326871] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112144, mem_used=264127488) [2024-06-24 16:58:46.326953] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219526326915000, start_id=1719219526326915000, end_id=1719219526326915001) [2024-06-24 16:58:46.343687] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:46.353658] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219526353344000, start_id=1719219526353344000, end_id=1719219526353344001) [2024-06-24 16:58:46.358722] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219526358632000, start_id=1719219526358632000, end_id=1719219526358632001) [2024-06-24 16:58:46.358762] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:46.359596] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.360237] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98343-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:46.363411] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A6B72-0-0] [lt=45][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:46.365546] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AE-0-0] [lt=52][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:46.365585] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AE-0-0] [lt=37][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:46.371300] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:46.371330] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:46.371950] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98345-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:46.376089] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98346-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:46.379272] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98347-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:46.383955] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.388609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:46.391703] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219526391386000, start_id=1719219526391386000, end_id=1719219526391386001) [2024-06-24 16:58:46.402897] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98350-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:46.405745] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98352-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:46.410217] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98354-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:46.413027] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:46.413129] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:46.413315] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:46.413374] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:46.413526] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:46.413596] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:46.413699] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98356-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:46.414158] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219526413517000, start_id=1719219526413517000, end_id=1719219526413517001) [2024-06-24 16:58:46.414235] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:46.414270] INFO [LIB] stat (utility.h:1165) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:46.414653] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=359, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:46.414680] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:46.414719] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=7, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:46.414757] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=422, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:46.414776] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=24, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:46.420108] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=27] dump dtl interm result cost(us)(dump_cost=3672, ret=0, interm count=0, dump count=627) [2024-06-24 16:58:46.421378] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129815, mem_used=326519808) [2024-06-24 16:58:46.423320] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=34] clear dtl interm result cost(us)(clear_cost=3176, ret=0, gc_.expire_keys_.count()=0, dump count=627, interm count=0, clean count=0) [2024-06-24 16:58:46.425448] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=11] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:46.425481] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=18] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1235) [2024-06-24 16:58:46.425805] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98357-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:46.437185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283412885504, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:46.459638] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.463193] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98364-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:46.465411] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:46.465981] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98365-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:46.466769] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219526466180000, start_id=1719219526466180000, end_id=1719219526466180001) [2024-06-24 16:58:46.478559] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1522, avg_group_log_size=169) [2024-06-24 16:58:46.478582] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1522) [2024-06-24 16:58:46.478973] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1522) [2024-06-24 16:58:46.481743] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:46.483994] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.494127] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [162824][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:46.514929] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98379-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:46.528130] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219526527669000, start_id=1719219526527669000, end_id=1719219526527669001) [2024-06-24 16:58:46.528594] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4969) [2024-06-24 16:58:46.528651] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4969) [2024-06-24 16:58:46.528817] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219526326915000, v:0}, new_max_version={val:1719219526326915000, v:0}, last_min_version={val:1719219526126143000, v:0}, last_max_version={val:1719219526126143000, v:0}, total_time_us=2660, delta_us=201900) [2024-06-24 16:58:46.528851] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219526326915000, v:0}, min_version={val:1719219526326915000, v:0}, max_version={val:1719219526326915000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:46.537319] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [967][T1001_ArcSender][T1001][YB42AC141156-00061B9D8DB0C0E5-0-0] [lt=32][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:46.540240] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2024-06-24 16:58:46.540279] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=33] start lib cache evict(tenant_id=1002, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:46.540297] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:46.540313] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:46.540382] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=25] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:46.548703] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=11] Dumping All Cache Objs(alloc_obj_list.count()=753, alloc_obj_list=[{obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:206, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:208, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:213, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:215, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:218, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:219, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:221, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:222, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:223, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:224, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:225, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:226, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:227, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:230, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:258, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:259, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207636}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157087}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:262, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417132}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:293, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:297, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178532}, {obj_id:299, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174372}, {obj_id:311, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:312, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:313, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:314, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:315, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:316, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:317, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:318, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:319, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:320, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:370, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:371, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:372, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:373, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:374, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:375, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:376, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:377, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:378, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:394, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217236}, {obj_id:404, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:405, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:431, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200789}, {obj_id:787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:1554, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174647}, {obj_id:1765, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196131}, {obj_id:1767, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180746}, {obj_id:1768, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180053}, {obj_id:1769, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156392}, {obj_id:1770, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185682}, {obj_id:1771, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178754}, {obj_id:1772, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217927}, {obj_id:1773, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182452}, {obj_id:1774, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157145}, {obj_id:1775, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193250}, {obj_id:1776, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156261}, {obj_id:1777, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202011}, {obj_id:1778, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176126}, {obj_id:1779, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:1780, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179533}, {obj_id:1782, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194286}, {obj_id:1783, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191084}, {obj_id:1784, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185716}, {obj_id:1785, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197901}, {obj_id:1786, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203431}, {obj_id:1787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177702}, {obj_id:1788, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197376}, {obj_id:1789, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194100}, {obj_id:1790, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229422}, {obj_id:1791, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342799}, {obj_id:1792, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177856}, {obj_id:1793, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:1794, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:1801, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197017}, {obj_id:1802, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197375}, {obj_id:1803, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192944}, {obj_id:1804, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210981}, {obj_id:1807, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1808, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191543}, {obj_id:1809, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190396}, {obj_id:1810, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179961}, {obj_id:1811, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187508}, {obj_id:1812, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190770}, {obj_id:1814, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174667}, {obj_id:1817, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186991}, {obj_id:1820, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181584}, {obj_id:1822, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201206}, {obj_id:1823, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187930}, {obj_id:1824, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182810}, {obj_id:1826, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205149}, {obj_id:1828, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181586}, {obj_id:1830, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184827}, {obj_id:1832, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173928}, {obj_id:1833, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241466}, {obj_id:1834, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173654}, {obj_id:1835, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174122}, {obj_id:1841, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183277}, {obj_id:1842, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202767}, {obj_id:1843, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184717}, {obj_id:1844, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179338}, {obj_id:1845, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192322}, {obj_id:1846, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186117}, {obj_id:1847, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:243066}, {obj_id:1850, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203203}, {obj_id:1851, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206987}, {obj_id:1854, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202239}, {obj_id:1857, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179623}, {obj_id:1858, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199630}, {obj_id:1859, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181089}, {obj_id:1860, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191144}, {obj_id:1861, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208300}, {obj_id:1862, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207006}, {obj_id:1864, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174459}, {obj_id:1865, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197772}, {obj_id:1866, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195985}, {obj_id:1867, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187545}, {obj_id:1868, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200975}, {obj_id:1869, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190129}, {obj_id:1870, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187648}, {obj_id:1871, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180383}, {obj_id:1872, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176694}, {obj_id:1873, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199714}, {obj_id:1874, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197401}, {obj_id:1875, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211269}, {obj_id:1878, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197823}, {obj_id:1879, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180556}, {obj_id:1880, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186838}, {obj_id:1881, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173640}, {obj_id:1882, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189084}, {obj_id:1883, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182778}, {obj_id:1884, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198543}, {obj_id:1885, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184808}, {obj_id:1886, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192715}, {obj_id:1887, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178511}, {obj_id:1889, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:1890, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190883}, {obj_id:1892, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204317}, {obj_id:1895, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200704}, {obj_id:1897, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180059}, {obj_id:1898, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189670}, {obj_id:1899, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297520}, {obj_id:1900, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180210}, {obj_id:1901, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173929}, {obj_id:1902, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207174}, {obj_id:1904, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180315}, {obj_id:1905, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175944}, {obj_id:1906, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191394}, {obj_id:1907, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205016}, {obj_id:1908, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205015}, {obj_id:1909, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205042}, {obj_id:1910, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183144}, {obj_id:1912, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156278}, {obj_id:1914, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201207}, {obj_id:1915, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205705}, {obj_id:1916, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179043}, {obj_id:1918, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210554}, {obj_id:1919, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211414}, {obj_id:1920, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203461}, {obj_id:1922, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179984}, {obj_id:1924, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194777}, {obj_id:1926, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212517}, {obj_id:1927, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185341}, {obj_id:1928, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211233}, {obj_id:1929, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180552}, {obj_id:1930, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199580}, {obj_id:1932, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200277}, {obj_id:1933, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202039}, {obj_id:1935, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202217}, {obj_id:1938, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:1939, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185428}, {obj_id:1940, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342648}, {obj_id:1941, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184408}, {obj_id:1942, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188029}, {obj_id:1943, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220581}, {obj_id:1944, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186138}, {obj_id:1945, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188109}, {obj_id:1946, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184071}, {obj_id:1947, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297497}, {obj_id:1948, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259587}, {obj_id:1949, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234741}, {obj_id:1950, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230127}, {obj_id:1951, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:1952, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199425}, {obj_id:1953, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204260}, {obj_id:1955, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186747}, {obj_id:1956, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186410}, {obj_id:1957, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180371}, {obj_id:1959, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186746}, {obj_id:1960, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:314579}, {obj_id:1961, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316276}, {obj_id:1962, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179253}, {obj_id:1963, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198957}, {obj_id:1964, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253315}, {obj_id:1965, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194531}, {obj_id:1966, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181919}, {obj_id:1968, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204268}, {obj_id:1969, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:1970, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156216}, {obj_id:1971, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:1973, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206972}, {obj_id:1974, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372622}, {obj_id:1975, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:1976, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:1977, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255312}, {obj_id:1978, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255070}, {obj_id:1979, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281856}, {obj_id:1980, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312870}, {obj_id:1982, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:1983, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210959}, {obj_id:1984, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:1986, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216413}, {obj_id:1987, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:1988, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207457}, {obj_id:1989, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197063}, {obj_id:1990, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202377}, {obj_id:1991, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319848}, {obj_id:1993, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177048}, {obj_id:1994, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179527}, {obj_id:1996, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:390465}, {obj_id:1997, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181650}, {obj_id:1998, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180128}, {obj_id:1999, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175288}, {obj_id:2000, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179784}, {obj_id:2001, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183026}, {obj_id:2002, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179032}, {obj_id:2003, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186850}, {obj_id:2004, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207791}, {obj_id:2005, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188599}, {obj_id:2006, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241706}, {obj_id:2007, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179781}, {obj_id:2008, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189180}, {obj_id:2010, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175346}, {obj_id:2011, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182950}, {obj_id:2012, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178932}, {obj_id:2013, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184319}, {obj_id:2014, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182003}, {obj_id:2015, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:383980}, {obj_id:2016, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175770}, {obj_id:2017, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180015}, {obj_id:2018, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219419}, {obj_id:2019, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204596}, {obj_id:2020, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181397}, {obj_id:2021, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179054}, {obj_id:2022, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156256}, {obj_id:2023, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237344}, {obj_id:2024, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209999}, {obj_id:2025, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230256}, {obj_id:2026, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188496}, {obj_id:2027, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179278}, {obj_id:2028, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192304}, {obj_id:2029, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195605}, {obj_id:2030, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183563}, {obj_id:2031, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182637}, {obj_id:2033, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:392174}, {obj_id:2035, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304600}, {obj_id:2037, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184788}, {obj_id:2038, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185565}, {obj_id:2039, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181321}, {obj_id:2040, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204506}, {obj_id:2041, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:348902}, {obj_id:2042, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222494}, {obj_id:2043, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220331}, {obj_id:2044, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181427}, {obj_id:2045, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226680}, {obj_id:2046, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192432}, {obj_id:2047, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225643}, {obj_id:2048, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174740}, {obj_id:2049, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215812}, {obj_id:2050, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196675}, {obj_id:2051, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179861}, {obj_id:2052, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204953}, {obj_id:2053, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196998}, {obj_id:2054, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179552}, {obj_id:2055, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197192}, {obj_id:2056, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187268}, {obj_id:2057, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185914}, {obj_id:2058, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205463}, {obj_id:2059, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:391976}, {obj_id:2060, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202155}, {obj_id:2061, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207183}, {obj_id:2062, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228354}, {obj_id:2063, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240497}, {obj_id:2064, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182911}, {obj_id:2065, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218028}, {obj_id:2066, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210463}, {obj_id:2067, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176755}, {obj_id:2068, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2069, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198027}, {obj_id:2070, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181248}, {obj_id:2071, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179856}, {obj_id:2072, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185425}, {obj_id:2073, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:365208}, {obj_id:2074, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189692}, {obj_id:2075, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183454}, {obj_id:2076, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238844}, {obj_id:2077, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321800}, {obj_id:2078, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186250}, {obj_id:2079, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196079}, {obj_id:2080, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332305}, {obj_id:2081, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320208}, {obj_id:2082, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251367}, {obj_id:2083, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182508}, {obj_id:2084, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300805}, {obj_id:2085, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178980}, {obj_id:2086, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178916}, {obj_id:2087, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209270}, {obj_id:2088, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184260}, {obj_id:2089, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183375}, {obj_id:2090, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240830}, {obj_id:2091, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201771}, {obj_id:2092, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192848}, {obj_id:2093, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185409}, {obj_id:2094, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185960}, {obj_id:2095, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178833}, {obj_id:2096, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184221}, {obj_id:2098, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186713}, {obj_id:2099, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215730}, {obj_id:2101, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197347}, {obj_id:2102, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193779}, {obj_id:2103, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234706}, {obj_id:2104, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179916}, {obj_id:2105, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204599}, {obj_id:2106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208576}, {obj_id:2107, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196385}, {obj_id:2108, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2109, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2110, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181778}, {obj_id:2114, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210988}, {obj_id:2115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209186}, {obj_id:2116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197363}, {obj_id:2117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223906}, {obj_id:2118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201491}, {obj_id:2119, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292238}, {obj_id:2120, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207205}, {obj_id:2122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226896}, {obj_id:2123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181523}, {obj_id:2124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213117}, {obj_id:2125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:2126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179447}, {obj_id:2127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183182}, {obj_id:2128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184816}, {obj_id:2129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200736}, {obj_id:2130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224430}, {obj_id:2132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207161}, {obj_id:2133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192675}, {obj_id:2135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385804}, {obj_id:2137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230239}, {obj_id:2153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202184}, {obj_id:2156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205408}, {obj_id:2157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206436}, {obj_id:2158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174583}, {obj_id:2162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213869}, {obj_id:2163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195408}, {obj_id:2164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203912}, {obj_id:2166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182577}, {obj_id:2167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181498}, {obj_id:2168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199791}, {obj_id:2169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184951}, {obj_id:2170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265434}, {obj_id:2171, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186761}, {obj_id:2172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180107}, {obj_id:2173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205227}, {obj_id:2174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210318}, {obj_id:2175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196533}, {obj_id:2176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180448}, {obj_id:2177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185110}, {obj_id:2178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191697}, {obj_id:2179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217620}, {obj_id:2180, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221861}, {obj_id:2181, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185962}, {obj_id:2182, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:422104}, {obj_id:2183, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190931}, {obj_id:2184, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192945}, {obj_id:2185, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179350}, {obj_id:2186, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:2187, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188846}, {obj_id:2188, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417908}, {obj_id:2189, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180199}, {obj_id:2195, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207911}, {obj_id:2203, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188121}, {obj_id:2204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196915}, {obj_id:2205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385249}, {obj_id:2209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2211, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem [2024-06-24 16:58:46.550474] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=1769] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:46.553790] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219526553015000, start_id=1719219526553015000, end_id=1719219526553015001) [2024-06-24 16:58:46.559696] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.566389] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=36] dump dtl interm result cost(us)(dump_cost=1545, ret=0, interm count=0, dump count=620) [2024-06-24 16:58:46.567739] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=22] clear dtl interm result cost(us)(clear_cost=1326, ret=0, gc_.expire_keys_.count()=0, dump count=620, interm count=0, clean count=0) [2024-06-24 16:58:46.570523] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=52] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:46.579132] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=467, avg_log_submit_to_slide_time=478) [2024-06-24 16:58:46.584055] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.588707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:46.591390] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC18-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103422682756, cache_obj->added_lc()=false, cache_obj->get_object_id()=9370, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:46.591818] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219526591112000, start_id=1719219526591112000, end_id=1719219526591112001) [2024-06-24 16:58:46.609368] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:46.614421] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219526614314000, start_id=1719219526614314000, end_id=1719219526614314001) [2024-06-24 16:58:46.614887] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8259) [2024-06-24 16:58:46.614935] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8259) [2024-06-24 16:58:46.614981] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=396, avg_log_submit_to_slide_time=408) [2024-06-24 16:58:46.621335] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=14] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:46.621464] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=29] gc stale ls task succ [2024-06-24 16:58:46.634432] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1719219526634429, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-06-24 16:58:46.636415] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=20] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13750, offset=3453744}, end_cursor:ObLogCursor{file_id=1, log_id=13751, offset=3454017}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9cfc050, len:3280, log_data_len:273, seq:13750, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:46.637749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283408691200, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:46.639506] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D915-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219526638542000, start_id=1719219526638542000, end_id=1719219526638542001) [2024-06-24 16:58:46.639580] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D915-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8260, avg_group_log_size=516) [2024-06-24 16:58:46.639608] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D915-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8259) [2024-06-24 16:58:46.640537] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13751, offset=3454017}, end_cursor:ObLogCursor{file_id=1, log_id=13752, offset=3454282}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d00050, len:3007, log_data_len:265, seq:13751, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:46.643939] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3961, avg_group_log_size=396) [2024-06-24 16:58:46.643958] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4384) [2024-06-24 16:58:46.644313] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=366, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:46.644347] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:46.659758] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.666895] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219526665898000, start_id=1719219526665898000, end_id=1719219526665898001) [2024-06-24 16:58:46.671884] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:46.671883] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=377, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:46.671921] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:46.671936] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:46.671951] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=455, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:46.671960] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:46.672800] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983B6-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:46.675754] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983B7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:46.678703] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4641, avg_group_log_size=386) [2024-06-24 16:58:46.678730] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4641) [2024-06-24 16:58:46.681218] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983B9-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:46.684117] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.684303] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C93CE-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:46.687180] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983BA-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:46.696084] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1353][T1004_LockWaitM][T1004][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=2620, bkt_cnt=7838) [2024-06-24 16:58:46.700449] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:46.705998] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD56-0-0] [lt=33] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:46.711025] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C4-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:46.714046] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C5-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:46.718887] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C7-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:46.721040] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [1593][T1003_ObXAHbWor][T1003][Y0-0000000000000000-0-0] [lt=31] XA scheduler heartbeat task statistics(avg_time=5) [2024-06-24 16:58:46.722799] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:46.722913] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:46.723178] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:46.723244] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:46.723423] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:46.723500] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:46.723608] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983C9-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:46.728412] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219526728061000, start_id=1719219526728061000, end_id=1719219526728061001) [2024-06-24 16:58:46.730799] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=17] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:46.741276] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983CA-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:46.744576] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041EE2-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219526743879000, start_id=1719219526743879000, end_id=1719219526743879001) [2024-06-24 16:58:46.745055] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4641) [2024-06-24 16:58:46.745118] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=4641) [2024-06-24 16:58:46.745160] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=31, avg_log_gen_to_submit_time=38, avg_log_submit_to_flush_time=405, avg_log_submit_to_slide_time=418) [2024-06-24 16:58:46.753933] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219526753399000, start_id=1719219526753399000, end_id=1719219526753399001) [2024-06-24 16:58:46.755456] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=551, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:46.755491] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:46.755503] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=5, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:46.755523] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=644, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:46.755534] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=9] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=21, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:46.759818] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.760193] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC12A03-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219526759747000, start_id=1719219526759747000, end_id=1719219526759747001) [2024-06-24 16:58:46.763044] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=25965, mem_used=124784640) [2024-06-24 16:58:46.771945] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:46.771965] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:46.771988] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=417, avg_log_submit_to_slide_time=424) [2024-06-24 16:58:46.783327] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983D7-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:46.784177] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.784589] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=33] new mysql sessid created(conn.sessid_=3221494479, support_ssl=false) [2024-06-24 16:58:46.784657] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221494479, sess.client_addr_="172.20.17.86:49528") [2024-06-24 16:58:46.784680] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494479, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:46.784806] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=38][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494479, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:46.784839] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=29] kill and revert session(conn.sessid_=3221494479, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:46.784854] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=14] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494479, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:46.784878] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494479) [2024-06-24 16:58:46.784891] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162504][sql_nio14][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494479, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:46.786401] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983D8-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:46.788794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:46.792214] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219526791462000, start_id=1719219526791462000, end_id=1719219526791462001) [2024-06-24 16:58:46.812062] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2024-06-24 16:58:46.812084] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=14] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:46.812112] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=12] cannot_recycle_log_size statistics(cannot_recycle_log_size=53499177, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:46.813332] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219526812609000, start_id=1719219526812609000, end_id=1719219526812609001) [2024-06-24 16:58:46.813900] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:46.823341] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:46.823393] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=32] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1235) [2024-06-24 16:58:46.826746] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=40] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=33, mem_used=49913856) [2024-06-24 16:58:46.826790] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=29] release old cannot free more memory [2024-06-24 16:58:46.826807] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=63, size_used=0, mem_used=49913856) [2024-06-24 16:58:46.838285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283414982656, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:46.840997] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB983ED-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:46.859442] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219526858990000, start_id=1719219526858990000, end_id=1719219526858990001) [2024-06-24 16:58:46.859876] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.867033] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219526866394000, start_id=1719219526866394000, end_id=1719219526866394001) [2024-06-24 16:58:46.873428] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873777] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873845] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873876] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.873882] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874048] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874203] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874204] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874205] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874209] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874355] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874387] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874474] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874542] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874594] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874612] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874659] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874661] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874670] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.874678] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.875002] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:46.884236] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.912027] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:46.928428] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219526927630000, start_id=1719219526927630000, end_id=1719219526927630001) [2024-06-24 16:58:46.928990] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=408, avg_log_submit_to_slide_time=420) [2024-06-24 16:58:46.941530] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=30] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:46.943968] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] Garbage Collector is running(seq_=621, gc_interval=10000000) [2024-06-24 16:58:46.944054] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=31] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:46.944081] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] self is leader, skip it(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:46.944108] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=105) [2024-06-24 16:58:46.944126] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:46.946139] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:46.947967] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=32] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:46.948005] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=33] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:46.948029] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=22] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:46.948044] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=40) [2024-06-24 16:58:46.948058] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:46.954024] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219526953986000, start_id=1719219526953986000, end_id=1719219526953986001) [2024-06-24 16:58:46.959935] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.960367] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=25] ====== tenant freeze timer task ====== [2024-06-24 16:58:46.971677] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:46.971714] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1913, avg_group_log_size=191) [2024-06-24 16:58:46.971740] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1913) [2024-06-24 16:58:46.971762] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:46.971795] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:46.972150] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1913) [2024-06-24 16:58:46.972172] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=420, avg_log_submit_to_slide_time=426) [2024-06-24 16:58:46.972194] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=49, this=0x7f46d7ab8280, extra_info="") [2024-06-24 16:58:46.972227] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=32] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=448, this=0x7f46d7ab84b0, extra_info="") [2024-06-24 16:58:46.972243] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=0, this=0x7f46d7ab86e0, extra_info="") [2024-06-24 16:58:46.972255] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=11] [APPLY STAT CB EXECUTE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=-445, this=0x7f46d7ab8910, extra_info="") [2024-06-24 16:58:46.972268] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=52, this=0x7f46d7ab8b40, extra_info="") [2024-06-24 16:58:46.972818] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=415, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:46.984294] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:46.988874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:46.992361] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219526991977000, start_id=1719219526991977000, end_id=1719219526991977001) [2024-06-24 16:58:46.992448] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9072, avg_group_log_size=604) [2024-06-24 16:58:46.992476] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9608) [2024-06-24 16:58:46.992875] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9072) [2024-06-24 16:58:46.992919] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9072) [2024-06-24 16:58:46.992947] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=35, avg_log_gen_to_submit_time=44, avg_log_submit_to_flush_time=578, avg_log_submit_to_slide_time=587) [2024-06-24 16:58:46.993607] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=36] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16503, offset=3760489}, end_cursor:ObLogCursor{file_id=1, log_id=16504, offset=3760762}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d04050, len:3735, log_data_len:273, seq:16503, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:46.997104] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D906-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219526996206000, start_id=1719219526996206000, end_id=1719219526996206001) [2024-06-24 16:58:46.998140] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16504, offset=3760762}, end_cursor:ObLogCursor{file_id=1, log_id=16505, offset=3761027}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d08050, len:3462, log_data_len:265, seq:16504, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:47.003338] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:47.004779] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1719219527004777, bytes: 170941157, bw: 0.019928 MB/s, add_ts: 1007615, add_bytes: 21055 [2024-06-24 16:58:47.009297] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98428-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:47.011100] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:787) [163649][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=48] ps cache evict(tenant_id=1, stmt_id_map_.size()=12, stmt_info_map_.size()=12, op.get_used_size()=26439, get_mem_high()=410706180, expired_stmt_ids.count()=0, closed_stmt_ids.count()=12) [2024-06-24 16:58:47.012555] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98429-0-0] [lt=41][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:47.013516] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219527013009000, start_id=1719219527013009000, end_id=1719219527013009001) [2024-06-24 16:58:47.018811] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9842B-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:47.021861] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9842C-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:47.024902] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9842D-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:47.034083] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1453][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=42] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:47.036237] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2024-06-24 16:58:47.036282] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=31] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:47.036317] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348856153, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:47.036838] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1004) [2024-06-24 16:58:47.036876] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=32] start lib cache evict(tenant_id=1004, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:47.036895] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=16] end lib cache evict(tenant_id=1004, cache_evict_num=0, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:47.036909] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=12] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:47.038541] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [162957][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=63] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f4841ffc2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:47.038833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283404496896, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:47.044512] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=14] Dumping All Cache Objs(alloc_obj_list.count()=497, alloc_obj_list=[{obj_id:35, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:39, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:40, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184250}, {obj_id:41, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:43, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:45, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:53, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175298}, {obj_id:84, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174332}, {obj_id:145, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:146, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:147, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:148, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:151, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:152, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:153, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:154, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:155, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:156, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:157, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:158, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:159, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:160, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198897}, {obj_id:161, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:162, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:163, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:164, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:165, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:166, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:167, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:168, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:169, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:170, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:171, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:172, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:173, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:174, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:175, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:176, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:177, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175451}, {obj_id:178, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181217}, {obj_id:179, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:180, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:181, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:182, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235894}, {obj_id:183, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209782}, {obj_id:184, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230576}, {obj_id:185, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:186, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:187, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:188, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:189, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:190, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:191, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:192, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:193, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:195, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:196, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:197, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:198, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:199, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:200, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:201, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:202, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:203, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:204, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:205, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:206, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:207, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:208, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:209, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:210, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:211, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:212, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:213, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:214, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:215, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:216, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299219}, {obj_id:217, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236649}, {obj_id:218, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:219, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184514}, {obj_id:220, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:221, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:222, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:223, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180301}, {obj_id:224, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:225, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:226, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:227, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:228, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183169}, {obj_id:229, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:230, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:232, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:235, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:236, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:237, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:238, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:239, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:240, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:241, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:242, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188148}, {obj_id:243, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:244, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:245, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:246, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:247, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:248, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:249, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:250, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:251, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:252, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:253, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:254, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:255, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206580}, {obj_id:256, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208496}, {obj_id:257, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:258, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308540}, {obj_id:260, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207652}, {obj_id:261, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:262, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172752}, {obj_id:263, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:264, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:265, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:266, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:267, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:268, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:269, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:270, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:271, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:272, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157105}, {obj_id:273, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175095}, {obj_id:274, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176760}, {obj_id:275, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185989}, {obj_id:276, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:277, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:278, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:279, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419083}, {obj_id:280, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417152}, {obj_id:283, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239831}, {obj_id:284, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242976}, {obj_id:285, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256105}, {obj_id:286, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256298}, {obj_id:287, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:288, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:289, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:290, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:291, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:292, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:293, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:294, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231047}, {obj_id:295, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:296, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:297, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:298, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:299, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215340}, {obj_id:300, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:301, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:302, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:303, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:304, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:307, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:308, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:311, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:375291}, {obj_id:312, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:384468}, {obj_id:313, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325700}, {obj_id:314, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:334948}, {obj_id:315, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227240}, {obj_id:316, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268192}, {obj_id:317, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200156}, {obj_id:318, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206516}, {obj_id:335, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182820}, {obj_id:349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191406}, {obj_id:352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:362, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204485}, {obj_id:363, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224055}, {obj_id:366, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185366}, {obj_id:367, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195268}, {obj_id:368, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:375, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:376, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:379, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:380, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234934}, {obj_id:381, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:382, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:383, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:384, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218544}, {obj_id:385, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:386, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:387, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:388, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:391, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189184}, {obj_id:392, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201018}, {obj_id:395, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191754}, {obj_id:396, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204870}, {obj_id:399, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:400, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:403, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:404, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:407, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:408, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199110}, {obj_id:411, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:412, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:425, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:426, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:427, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:428, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:429, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:430, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217209}, {obj_id:431, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:432, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:433, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:434, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:437, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201929}, {obj_id:438, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220211}, {obj_id:441, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186646}, {obj_id:442, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197186}, {obj_id:449, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187051}, {obj_id:450, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236235}, {obj_id:451, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291681}, {obj_id:452, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229118}, {obj_id:453, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200168}, {obj_id:454, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219871}, {obj_id:455, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201375}, {obj_id:456, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291677}, {obj_id:457, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181926}, {obj_id:458, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201455}, {obj_id:461, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198111}, {obj_id:462, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214476}, {obj_id:473, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212131}, {obj_id:474, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235568}, {obj_id:489, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203200}, {obj_id:490, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222135}, {obj_id:493, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:494, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:497, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252923}, {obj_id:498, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296972}, {obj_id:509, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:510, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237536}, {obj_id:511, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292049}, {obj_id:512, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229486}, {obj_id:513, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200544}, {obj_id:514, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221206}, {obj_id:515, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201791}, {obj_id:516, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292045}, {obj_id:517, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182278}, {obj_id:518, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201839}, {obj_id:521, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263105}, {obj_id:522, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312324}, {obj_id:527, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269484}, {obj_id:528, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321943}, {obj_id:537, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254176}, {obj_id:538, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:298902}, {obj_id:551, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251638}, {obj_id:552, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295058}, {obj_id:555, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223603}, {obj_id:556, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252824}, {obj_id:573, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190308}, {obj_id:574, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238837}, {obj_id:575, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292385}, {obj_id:576, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229822}, {obj_id:577, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200872}, {obj_id:578, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222549}, {obj_id:579, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202111}, {obj_id:580, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292381}, {obj_id:581, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182630}, {obj_id:582, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202159}, {obj_id:587, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:588, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:611, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205738}, {obj_id:612, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225979}, {obj_id:625, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274568}, {obj_id:626, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329621}, {obj_id:643, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:644, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:645, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206454}, {obj_id:646, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:647, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:648, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:649, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197356}, {obj_id:650, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178512}, {obj_id:651, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198928}, {obj_id:652, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199105}, {obj_id:653, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156378}, {obj_id:654, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157162}, {obj_id:655, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176121}, {obj_id:656, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:657, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:307685}, {obj_id:658, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:660, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312830}, {obj_id:661, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:662, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:663, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:664, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202402}, {obj_id:665, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:666, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216429}, {obj_id:667, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:668, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157107}, {obj_id:669, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176570}, {obj_id:670, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176412}, {obj_id:672, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:673, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156195}, {obj_id:674, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:676, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:677, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372653}, {obj_id:678, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:679, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:680, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255326}, {obj_id:681, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255084}, {obj_id:682, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281876}, {obj_id:683, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319873}, {obj_id:684, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209231}, {obj_id:700, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192790}, {obj_id:701, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257630}, {obj_id:702, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234000}, {obj_id:731, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200128}, {obj_id:733, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:409897}, {obj_id:734, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:400862}, {obj_id:736, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175113}, {obj_id:737, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184566}, {obj_id:742, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175296}, {obj_id:743, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181792}, {obj_id:746, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185582}, {obj_id:747, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:797, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200312}, {obj_id:798, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198098}, {obj_id:799, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288253}, {obj_id:800, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:801, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200393}, {obj_id:802, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213250}, {obj_id:803, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328028}, {obj_id:804, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198852}, {obj_id:805, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:806, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:807, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:808, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:809, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174410}, {obj_id:815, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173948}, {obj_id:825, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185181}, {obj_id:828, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238944}, {obj_id:832, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:833, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:834, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:835, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:836, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188748}, {obj_id:837, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207583}, {obj_id:838, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220441}, {obj_id:839, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189684}, {obj_id:840, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183154}, {obj_id:841, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246969}, {obj_id:842, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249608}, {obj_id:843, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231450}, {obj_id:844, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180118}, {obj_id:845, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268752}, {obj_id:846, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270542}, {obj_id:847, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270227}, {obj_id:848, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273208}, {obj_id:849, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257627}, {obj_id:850, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273232}, {obj_id:851, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254489}, {obj_id:852, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269717}, {obj_id:853, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175231}, {obj_id:854, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181662}, {obj_id:855, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177134}, {obj_id:861, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177715}, {obj_id:869, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187847}, {obj_id:879, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200764}, {obj_id:880, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200755}, {obj_id:930, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:466821}, {obj_id:931, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:932, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296709}, {obj_id:933, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318958}, {obj_id:934, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312747}, {obj_id:935, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325200}, {obj_id:936, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217553}, {obj_id:937, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281577}, {obj_id:938, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189394}, {obj_id:939, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:641561}, {obj_id:940, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:244732}, {obj_id:941, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232660}, {obj_id:942, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:943, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:944, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217413}, {obj_id:945, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189522}, {obj_id:946, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232546}, {obj_id:1073, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246494}, {obj_id:1140, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:378647}, {obj_id:1141, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306509}, {obj_id:1142, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1143, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:1144, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198777}, {obj_id:1194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247404}, {obj_id:1320, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:438066}, {obj_id:1321, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260903}, {obj_id:1322, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206816}, {obj_id:1323, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193061}, {obj_id:1324, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178317}, {obj_id:1325, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182140}, {obj_id:1326, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174724}, {obj_id:1327, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195853}, {obj_id:1328, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184944}, {obj_id:1329, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201089}, {obj_id:1330, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209476}, {obj_id:1331, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:170609}, {obj_id:1332, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171169}, {obj_id:1333, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203806}, {obj_id:1334, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200651}, {obj_id:1336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195256}, {obj_id:1337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203334}, {obj_id:1338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198057}, {obj_id:1339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192160}, {obj_id:1340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194971}, {obj_id:1341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196164}, {obj_id:1342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198958}, {obj_id:1343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197940}, {obj_id:1344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200683}, {obj_id:1345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197036}, {obj_id:1346, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199801}, {obj_id:1347, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204590}, {obj_id:1348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197459}, {obj_id:1349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207323}, {obj_id:1350, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200262}, {obj_id:1351, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197164}, {obj_id:1353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199224}, {obj_id:1354, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201933}, {obj_id:1355, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202018}, {obj_id:1356, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206006}, {obj_id:1357, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204664}, {obj_id:1358, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205068}, {obj_id:1359, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208689}, {obj_id:1360, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207750}, {obj_id:1361, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209040}, {obj_id:13 [2024-06-24 16:58:47.046160] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=1642] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:47.053133] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98435-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:47.055522] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 359.50) [2024-06-24 16:58:47.055544] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:47.055616] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 377.50) [2024-06-24 16:58:47.055637] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:47.055657] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055670] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055654] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:47.055679] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055686] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055691] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055697] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055705] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055720] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055730] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055736] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055743] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055749] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055757] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.055769] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:47.056484] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98436-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:47.059997] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.061783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98438-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:47.062379] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=18119340, clean_num=201326) [2024-06-24 16:58:47.065346] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:47.065461] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:47.065685] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:47.065748] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:47.065919] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:47.065994] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:47.066095] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A706B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:47.067102] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219527066863000, start_id=1719219527066863000, end_id=1719219527066863001) [2024-06-24 16:58:47.079647] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:47.079690] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=29] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:47.079711] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1234) [2024-06-24 16:58:47.084354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.085702] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107536D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:47.096033] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096169] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096250] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096699] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096696] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.096971] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097063] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097119] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097136] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=1006, mem_used=2079744) [2024-06-24 16:58:47.097213] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097217] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097334] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097339] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097376] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097416] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097420] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097514] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097557] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097586] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097701] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097760] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097860] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097903] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=90] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097910] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.097975] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098031] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098079] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098376] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098597] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098638] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098642] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098666] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098694] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.098709] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.121423] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=22] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:47.127921] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A70C2-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:47.128565] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219527128089000, start_id=1719219527128089000, end_id=1719219527128089001) [2024-06-24 16:58:47.130934] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075397-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:47.134328] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1913) [2024-06-24 16:58:47.134803] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:47.136832] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=29] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:47.153802] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2024-06-24 16:58:47.153990] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B7-0-0] [lt=26] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219534521932000, latest_log_ts:{val:1719219517910315001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:47.154135] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B7-0-0] [lt=137] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:47.154153] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219527153419000, start_id=1719219527153419000, end_id=1719219527153419001) [2024-06-24 16:58:47.160058] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.166731] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E3-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:47.166767] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E3-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:47.167902] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FE-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:47.167946] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FE-0-0] [lt=41] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:47.171835] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:47.172286] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:47.172307] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:47.172319] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=494, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:47.172326] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:47.175995] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=25] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:47.184413] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.185126] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10753CB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:47.188971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:47.192445] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219527192282000, start_id=1719219527192282000, end_id=1719219527192282001) [2024-06-24 16:58:47.198652] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:47.198864] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B7-0-0] [lt=30] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219524856668001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219533569925000, latest_log_ts:{val:1719219517342441001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:47.199255] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B7-0-0] [lt=125] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219526858990003, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219524856668001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:47.199366] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B7-0-0] [lt=105] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:47.202020] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=33] gc stale ls task succ [2024-06-24 16:58:47.213523] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219527213361000, start_id=1719219527213361000, end_id=1719219527213361001) [2024-06-24 16:58:47.244268] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:47.244291] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:47.244724] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:47.244747] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=445, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:47.244761] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:47.260118] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.262888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283410788352, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:47.267201] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219527267112000, start_id=1719219527267112000, end_id=1719219527267112001) [2024-06-24 16:58:47.279014] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:47.279055] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:47.279085] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:47.279107] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:47.279425] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=351, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:47.279428] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=391, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:47.279459] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:47.279459] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:47.279482] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:47.279509] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=428, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:47.279502] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A6726-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=29, this=0x7f473495c280, extra_info="") [2024-06-24 16:58:47.279534] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=28, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:47.279532] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A6726-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=421, this=0x7f473495c4b0, extra_info="") [2024-06-24 16:58:47.279548] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A6726-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=0, this=0x7f473495c6e0, extra_info="") [2024-06-24 16:58:47.279562] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:47.279563] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A6726-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=-412, this=0x7f473495c910, extra_info="") [2024-06-24 16:58:47.279575] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A6726-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=39, this=0x7f473495cb40, extra_info="") [2024-06-24 16:58:47.279577] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=487, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:47.279590] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=25, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:47.284467] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.301510] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2024-06-24 16:58:47.301549] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:47.301579] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=70373482, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:47.326984] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112189, mem_used=264127488) [2024-06-24 16:58:47.328564] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219527328265000, start_id=1719219527328265000, end_id=1719219527328265001) [2024-06-24 16:58:47.330010] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:47.333607] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE766-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219527333542000, start_id=1719219527333542000, end_id=1719219527333542001) [2024-06-24 16:58:47.334114] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71B5-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219527333542000, start_id=1719219527333542001, end_id=1719219527333542002) [2024-06-24 16:58:47.339580] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041F0A-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219527338802000, start_id=1719219527338802000, end_id=1719219527338802001) [2024-06-24 16:58:47.342691] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=21] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:47.343820] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=33] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:47.345093] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075461-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:47.348044] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB985D3-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:47.353303] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1003, min_version={val:1719219527153419000, v:0}, base_version={val:1719219526953986000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219527153419000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219527353294, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:47.353767] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71D2-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:47.354231] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219527353580000, start_id=1719219527353580000, end_id=1719219527353580001) [2024-06-24 16:58:47.356664] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71D3-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:47.359614] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107546C-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:47.360168] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219527359914000, start_id=1719219527359914000, end_id=1719219527359914001) [2024-06-24 16:58:47.360178] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.360213] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:47.360684] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=24] submit log success(service_type_=0, last_id=1719219543569925000, limited_id=1719219543569925000) [2024-06-24 16:58:47.360704] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=19] submit log with lock success(service_type_=0, last_id=1719219543569925000, limited_id=1719219543569925000) [2024-06-24 16:58:47.360732] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=355, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:47.360755] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219527360648], gts:1719219527359914000, latest_srr:[mts=1719219527360648]}) [2024-06-24 16:58:47.361080] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1719219543569925000, latest_scn={val:1719219527359914001, v:0}, *this={tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219524856668001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:47.361167] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=85] handle submit callback(service_type_=0, success=true, used_ts=483, log_ts={val:1719219527359914001, v:0}, limited_id=1719219543569925000) [2024-06-24 16:58:47.361187] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:47.361205] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=17] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:47.371948] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:47.371985] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:47.379539] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AF-0-0] [lt=68][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:47.379564] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8AF-0-0] [lt=23][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:47.384481] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71E9-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:47.384527] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.387515] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [713][T1002_L0_G0][T1002][YB42AC141156-00061B9D92E11E1F-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:47.389064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:47.392352] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F2-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:47.392548] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219527391540000, start_id=1719219527391540000, end_id=1719219527391540001) [2024-06-24 16:58:47.395302] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:47.395420] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:47.395638] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:47.395708] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:47.395875] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:47.395958] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:47.396062] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A71F7-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:47.408836] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE76B-0-0] [lt=53][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:47.413585] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219527412629000, start_id=1719219527412629000, end_id=1719219527412629001) [2024-06-24 16:58:47.421507] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129827, mem_used=326519808) [2024-06-24 16:58:47.430057] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1387][T1004_ArcSender][T1004][YB42AC141156-00061B9D9370C0E5-0-0] [lt=17][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:47.450798] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10754B2-0-0] [lt=44][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:47.453865] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10754B3-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:47.460237] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.462437] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163799][T1002_TntTransf][T1002][YB42AC141156-00061B9D9190C350-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:47.463385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283410788352, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:47.465358] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1719219527133376000, v:0}, base_version={val:1719219526858990000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219527133376000, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219527465339, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:47.467346] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219527466482000, start_id=1719219527466482000, end_id=1719219527466482001) [2024-06-24 16:58:47.467422] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:47.467458] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:47.467813] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=413, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:47.467841] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=12, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:47.467871] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:47.467896] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=469, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:47.467914] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=23, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:47.472937] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163796][T1002_TntTransf][T1002][YB42AC141156-00061B9D9160C350-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:47.479233] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1791, avg_group_log_size=199) [2024-06-24 16:58:47.479268] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1791) [2024-06-24 16:58:47.479644] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1791) [2024-06-24 16:58:47.481855] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:47.484585] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.484737] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=47] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:47.484778] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=27] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1255) [2024-06-24 16:58:47.510997] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10754E0-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:47.515963] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163798][T1002_TntTransf][T1002][YB42AC141156-00061B9D9180C350-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:47.516374] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163797][T1002_TntTransf][T1002][YB42AC141156-00061B9D9170C350-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:47.528675] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219527527767000, start_id=1719219527527767000, end_id=1719219527527767001) [2024-06-24 16:58:47.529154] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4617) [2024-06-24 16:58:47.529198] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4617) [2024-06-24 16:58:47.529354] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219527328265000, v:0}, new_max_version={val:1719219527328265000, v:0}, last_min_version={val:1719219527128089000, v:0}, last_max_version={val:1719219527128089000, v:0}, total_time_us=2646, delta_us=201088) [2024-06-24 16:58:47.529388] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219527328265000, v:0}, min_version={val:1719219527328265000, v:0}, max_version={val:1719219527328265000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:47.540566] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=29] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:47.554320] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219527554163000, start_id=1719219527554163000, end_id=1719219527554163001) [2024-06-24 16:58:47.557420] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:47.559163] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:47.559266] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=25] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526709080000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:47.559306] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:651) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1719219526709080000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1001, freeze_info:{latest_snapshot_gc_scn:{val:1719219526709080000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}}) [2024-06-24 16:58:47.560299] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.579570] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=14, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=433, avg_log_submit_to_slide_time=447) [2024-06-24 16:58:47.584633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.589153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:47.592711] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219527592337000, start_id=1719219527592337000, end_id=1719219527592337001) [2024-06-24 16:58:47.596000] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC19-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103423687372, cache_obj->added_lc()=false, cache_obj->get_object_id()=9371, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:47.613744] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219527613583000, start_id=1719219527613583000, end_id=1719219527613583001) [2024-06-24 16:58:47.621447] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:47.621522] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:47.642048] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1719219527642044, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-06-24 16:58:47.644038] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=30] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13752, offset=3454282}, end_cursor:ObLogCursor{file_id=1, log_id=13753, offset=3454555}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d10050, len:2742, log_data_len:273, seq:13752, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:47.644500] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=4617, avg_group_log_size=461) [2024-06-24 16:58:47.644523] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4617) [2024-06-24 16:58:47.644884] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=381, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:47.644920] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:47.646774] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D916-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219527646524000, start_id=1719219527646524000, end_id=1719219527646524001) [2024-06-24 16:58:47.646849] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D916-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=9865, avg_group_log_size=580) [2024-06-24 16:58:47.646878] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D916-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9865) [2024-06-24 16:58:47.647204] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=10990) [2024-06-24 16:58:47.647239] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=10990) [2024-06-24 16:58:47.647273] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=442, avg_log_submit_to_slide_time=451) [2024-06-24 16:58:47.647842] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13753, offset=3454555}, end_cursor:ObLogCursor{file_id=1, log_id=13754, offset=3454820}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d0c050, len:2469, log_data_len:265, seq:13753, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:47.660365] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.663902] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283406594048, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:47.667414] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219527666716000, start_id=1719219527666716000, end_id=1719219527666716001) [2024-06-24 16:58:47.672535] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=379, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:47.672532] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:47.672562] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:47.672585] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:47.672599] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=439, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:47.672607] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:47.680738] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7345-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:47.683919] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7346-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:47.684693] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.689978] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A734B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:47.693269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9882D-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:47.694888] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:60150, max_lsn:32444692, max_scn:{val:1719219527359914003, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:32444692}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:0}}, last_submit_lsn:{lsn:32444570}, last_submit_end_lsn:{lsn:32444692}, last_submit_log_id:60150, last_submit_log_pid:1, max_flushed_lsn:{lsn:32444570}, max_flushed_end_lsn:{lsn:32444692}, max_flushed_log_pid:1, committed_end_lsn:{lsn:32444692}, last_slide_log_id:60150, last_slide_scn:{val:1719219527359914003, v:0}, last_slide_lsn:{lsn:32444570}, last_slide_end_lsn:{lsn:32444692}, last_slide_log_pid:1, last_slide_log_accum_checksum:1303055689, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4753cb2530}, [StateMgr]={this:0x7f4753cb62b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:60151, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213336021808, palf_role_change_cb:0x7f4753cbccb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4753cb3c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/meta", dir_fd:670, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f4753cb8478, flashback_version:0}, log_storage:{log_tail:{lsn:32444692}, readable_log_tail:{lsn:32444692}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/log", dir_fd:671, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:34660076, block_header_serialize_buf_:0x7f4753cba138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213336021452, this:0x7f4753cb69f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213336022204, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4753cb6430}) [2024-06-24 16:58:47.695262] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=369] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219527679615, last_flushed_end_lsn:{lsn:32444692}}]) [2024-06-24 16:58:47.695288] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=60151, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219527679615, last_flushed_end_lsn:{lsn:32444692}}]) [2024-06-24 16:58:47.696450] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7353-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:47.700514] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:47.722463] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A736C-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:47.723115] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:47.723147] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:47.723185] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=23] cannot_recycle_log_size statistics(cannot_recycle_log_size=103075232, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:47.725248] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A736E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:47.728373] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=26] ====== tenant freeze timer task ====== [2024-06-24 16:58:47.728798] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219527728335000, start_id=1719219527728335000, end_id=1719219527728335001) [2024-06-24 16:58:47.729793] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7373-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:47.730878] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:47.732404] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:47.732508] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:47.732714] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:47.732776] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:47.732932] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:47.733002] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:47.733097] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7378-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:47.743829] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=23] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:47.745320] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075594-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:47.748557] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=52] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:47.754472] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219527753686000, start_id=1719219527753686000, end_id=1719219527753686001) [2024-06-24 16:58:47.760423] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.763167] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=29544, mem_used=133103616) [2024-06-24 16:58:47.763393] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A73A0-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219527763198000, start_id=1719219527763198000, end_id=1719219527763198001) [2024-06-24 16:58:47.763473] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A73A0-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=6384, avg_group_log_size=399) [2024-06-24 16:58:47.763502] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A73A0-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=5967) [2024-06-24 16:58:47.763834] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=5845) [2024-06-24 16:58:47.763891] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=5845) [2024-06-24 16:58:47.763933] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=12, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=391, avg_log_submit_to_slide_time=402) [2024-06-24 16:58:47.772653] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1919) [2024-06-24 16:58:47.772672] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=4] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:47.772696] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=476, avg_log_submit_to_slide_time=483) [2024-06-24 16:58:47.777794] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988C6-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219527776919000, start_id=1719219527776919000, end_id=1719219527776919001) [2024-06-24 16:58:47.783919] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=31] new mysql sessid created(conn.sessid_=3221494480, support_ssl=false) [2024-06-24 16:58:47.783999] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221494480, sess.client_addr_="172.20.17.86:49530") [2024-06-24 16:58:47.784023] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f47833c2030, session_id:3221494480, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:47.784101] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494480, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:47.784137] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=32] kill and revert session(conn.sessid_=3221494480, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:47.784154] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494480, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:47.784178] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494480) [2024-06-24 16:58:47.784191] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162505][sql_nio15][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494480, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:47.784752] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.788225] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10755BD-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:47.789244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:47.790777] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=30] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1004, min_version={val:1719219527359914002, v:0}, base_version={val:1719219527359914000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219527359914002, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219527790762, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:47.791388] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A73D0-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:47.792812] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219527792751000, start_id=1719219527792751000, end_id=1719219527792751001) [2024-06-24 16:58:47.792887] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:47.792921] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:47.793302] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=366, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:47.793335] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=13, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:47.793355] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=5, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:47.793378] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=420, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:47.793392] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=19, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:47.803409] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988CD-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:47.813845] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219527813839000, start_id=1719219527813839000, end_id=1719219527813839001) [2024-06-24 16:58:47.823637] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=26][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:47.826923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=18] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=28, mem_used=49913856) [2024-06-24 16:58:47.826961] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=27] release old cannot free more memory [2024-06-24 16:58:47.826976] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=54, size_used=0, mem_used=49913856) [2024-06-24 16:58:47.838570] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=17] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:47.838601] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=19] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:47.838639] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1252) [2024-06-24 16:58:47.846999] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A741C-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:47.857833] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=20] current monitor number(seq_=-1) [2024-06-24 16:58:47.860482] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.861103] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219527860157000, start_id=1719219527860157000, end_id=1719219527860157001) [2024-06-24 16:58:47.861136] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=27] ts response task statistics(alloc_count=248682, free_count=124340) [2024-06-24 16:58:47.861166] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219527861095], gts:1719219527860157000, latest_srr:[mts=1719219527861095]}) [2024-06-24 16:58:47.861205] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219527861189], gts:1719219527860157000, latest_srr:[mts=1719219527861189]}) [2024-06-24 16:58:47.861235] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219527861222], gts:1719219527861214000, latest_srr:[mts=1719219527861222]}) [2024-06-24 16:58:47.861283] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1003][Y0-0000000000000000-0-0] [lt=14] submit log success(service_type_=0, last_id=1719219544521932000, limited_id=1719219544521932000) [2024-06-24 16:58:47.861299] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1003][Y0-0000000000000000-0-0] [lt=15] submit log with lock success(service_type_=0, last_id=1719219544521932000, limited_id=1719219544521932000) [2024-06-24 16:58:47.861324] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=13] gts statistics(tenant_id=1003, gts_rpc_cnt=10, get_gts_cache_cnt=388, get_gts_with_stc_cnt=66, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:47.861345] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219527861250], gts:1719219527861214000, latest_srr:[mts=1719219527861250]}) [2024-06-24 16:58:47.861735] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=5] update id meta(ret=0, service_type=0, limited_id=1719219544521932000, latest_scn={val:1719219527861214001, v:0}, *this={tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:47.861784] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=48] handle submit callback(service_type_=0, success=true, used_ts=501, log_ts={val:1719219527861214001, v:0}, limited_id=1719219544521932000) [2024-06-24 16:58:47.861793] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=9] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:47.861803] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=10] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:47.864396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283402399744, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:47.867534] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219527866495000, start_id=1719219527866495000, end_id=1719219527866495001) [2024-06-24 16:58:47.873454] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873658] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873822] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.873880] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874184] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874636] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874658] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874665] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874663] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874707] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874741] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874736] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874830] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.874946] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:47.884811] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.907711] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=12] ====== traversal_flush timer task ====== [2024-06-24 16:58:47.907977] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CB-0-0] [lt=19] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:47.908113] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CB-0-0] [lt=128] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:47.912076] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:47.928924] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219527928628000, start_id=1719219527928628000, end_id=1719219527928628001) [2024-06-24 16:58:47.954554] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219527953963000, start_id=1719219527953963000, end_id=1719219527953963001) [2024-06-24 16:58:47.960541] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.972334] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:47.972368] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1226, avg_group_log_size=122) [2024-06-24 16:58:47.972394] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1226) [2024-06-24 16:58:47.972415] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:47.972447] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:47.972709] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1226) [2024-06-24 16:58:47.972752] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=417, avg_log_submit_to_slide_time=425) [2024-06-24 16:58:47.972935] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=404, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:47.984869] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:47.989338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:47.991361] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1971][T1004_TTLTablet][T1004][YB42AC141156-00061B9D9A50C34B-0-0] [lt=37] finish reload tenant task(local_tenant_task_={tenant_id:1004, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:47.992864] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219527992010000, start_id=1719219527992010000, end_id=1719219527992010001) [2024-06-24 16:58:47.992948] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7892, avg_group_log_size=607) [2024-06-24 16:58:47.992975] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7892) [2024-06-24 16:58:47.993308] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7892) [2024-06-24 16:58:47.993358] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7892) [2024-06-24 16:58:47.993390] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=400, avg_log_submit_to_slide_time=410) [2024-06-24 16:58:47.995054] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=48] LogLoopThread round_cost_time(us)(round_cost_time=23) [2024-06-24 16:58:48.001784] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16505, offset=3761027}, end_cursor:ObLogCursor{file_id=1, log_id=16506, offset=3761300}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d14050, len:3197, log_data_len:273, seq:16505, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:48.003397] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:48.005766] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D907-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219528005759000, start_id=1719219528005759000, end_id=1719219528005759001) [2024-06-24 16:58:48.006770] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16506, offset=3761300}, end_cursor:ObLogCursor{file_id=1, log_id=16507, offset=3761565}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d18050, len:2924, log_data_len:265, seq:16506, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:48.012391] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1719219528012388, bytes: 170960797, bw: 0.018589 MB/s, add_ts: 1007611, add_bytes: 19640 [2024-06-24 16:58:48.013931] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219528013165000, start_id=1719219528013165000, end_id=1719219528013165001) [2024-06-24 16:58:48.014444] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:48.019817] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10756E8-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.023290] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10756E9-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.028452] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C041FE7-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.028931] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [928][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=23][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:48.029041] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [928][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=38][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:48.031457] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10756EE-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.035060] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A751E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4801, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.043994] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1719219518041896, end_time=1719219528043990, dag_status={}) [2024-06-24 16:58:48.044031] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044087] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044102] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044116] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044130] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044160] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:48.044171] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044191] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044207] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044226] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044308] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044339] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044374] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044390] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044406] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044422] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044439] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044461] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044477] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044495] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044511] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044528] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044545] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044577] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044593] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044609] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044647] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044666] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044682] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044698] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044728] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044744] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044760] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044776] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044794] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044811] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044827] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044843] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044860] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044877] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044894] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044910] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044928] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044944] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044960] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044975] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.044992] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045008] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045024] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045059] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045075] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045091] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045107] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045095] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=458, avg_log_submit_to_slide_time=470) [2024-06-24 16:58:48.045124] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:48.045162] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:48.045176] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:48.045192] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:48.045205] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:48.045215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:48.045227] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:48.045240] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:48.045252] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:48.045264] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:48.045276] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:48.045290] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:48.055774] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:48.056984] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 414.00) [2024-06-24 16:58:48.057000] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:48.057067] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 364.50) [2024-06-24 16:58:48.057077] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:48.057097] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057108] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057115] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057121] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057130] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057136] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057149] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057158] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057167] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057175] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057180] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057189] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057194] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057200] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057206] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:48.057639] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075714-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.060601] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.060962] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A753C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:48.064910] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283404496896, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:48.066268] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107571E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:48.067696] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219528067068000, start_id=1719219528067068000, end_id=1719219528067068001) [2024-06-24 16:58:48.069682] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:48.069795] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:48.070004] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:48.070067] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:48.070230] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:48.070302] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:48.070407] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A754A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:48.078782] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988D6-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:48.079044] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988D6-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:48.079539] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988D6-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:48.079982] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988D6-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:48.080262] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB988D6-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:48.083117] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A755D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.084927] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.096283] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096311] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096721] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096734] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096735] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096766] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096764] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.096768] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097241] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097253] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097257] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097289] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=39] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1059, mem_used=2079744) [2024-06-24 16:58:48.097338] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097375] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097456] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097501] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097514] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097584] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097634] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097670] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097893] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097905] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097965] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097970] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.097990] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098123] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098425] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098640] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098680] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098677] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098704] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.098751] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.099101] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.101202] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:74598, max_lsn:57987388, max_scn:{val:1719219527861214002, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:57987388}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16044348}}, last_submit_lsn:{lsn:57987266}, last_submit_end_lsn:{lsn:57987388}, last_submit_log_id:74598, last_submit_log_pid:1, max_flushed_lsn:{lsn:57987266}, max_flushed_end_lsn:{lsn:57987388}, max_flushed_log_pid:1, committed_end_lsn:{lsn:57987388}, last_slide_log_id:74598, last_slide_scn:{val:1719219527861214002, v:0}, last_slide_lsn:{lsn:57987266}, last_slide_end_lsn:{lsn:57987388}, last_slide_log_pid:1, last_slide_log_accum_checksum:3010751099, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d2f88530}, [StateMgr]={this:0x7f46d2f8c2b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:74599, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213376431572, palf_role_change_cb:0x7f46d2f92cb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d2f89c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213369678630002, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1719213369678630001, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/meta", dir_fd:689, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d2f8e478, flashback_version:0}, log_storage:{log_tail:{lsn:57987388}, readable_log_tail:{lsn:57987388}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1719213369678630002, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/log", dir_fd:690, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:9117380, block_header_serialize_buf_:0x7f46d2f90138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213376431519, this:0x7f46d2f8c9f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213376432460, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d2f8c430}) [2024-06-24 16:58:48.101562] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=355] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219528072808, last_flushed_end_lsn:{lsn:57987388}}]) [2024-06-24 16:58:48.101590] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=74599, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219528072808, last_flushed_end_lsn:{lsn:57987388}}]) [2024-06-24 16:58:48.112241] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=14] ====== check clog disk timer task ====== [2024-06-24 16:58:48.112265] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:48.112303] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=21] cannot_recycle_log_size statistics(cannot_recycle_log_size=73623207, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:48.115319] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163032][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD23-0-0] [lt=36] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:48.115359] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163032][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD23-0-0] [lt=32] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=48) [2024-06-24 16:58:48.124502] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB9892B-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:48.127734] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A759E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.129038] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219528128315000, start_id=1719219528128315000, end_id=1719219528128315001) [2024-06-24 16:58:48.134920] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:48.144976] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=21] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:48.154579] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138A0-0-0] [lt=18] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336804351806640625e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.884802049386820499e+01) [2024-06-24 16:58:48.154732] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219528154726000, start_id=1719219528154726000, end_id=1719219528154726001) [2024-06-24 16:58:48.160661] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.168727] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E4-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:48.168764] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E4-0-0] [lt=33] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:48.169856] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FF-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:48.169890] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D8FF-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:48.172496] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:48.172844] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:48.172885] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:48.172914] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=444, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:48.172932] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:48.176086] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=26] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:48.179870] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:48.183103] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042060-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:48.184848] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB989CF-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:48.184984] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.185096] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB989CF-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:48.186542] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D430-0-0] [lt=24] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:48.188817] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB989D2-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:48.189430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:48.192987] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219528192681000, start_id=1719219528192681000, end_id=1719219528192681001) [2024-06-24 16:58:48.202083] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:48.215124] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219528214805000, start_id=1719219528214805000, end_id=1719219528214805001) [2024-06-24 16:58:48.222779] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:48.222909] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:48.222958] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:48.223008] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:48.223088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:48.223218] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:48.223269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:48.223311] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:48.223427] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:48.223472] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:48.223547] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:48.223590] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:48.223706] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:48.223753] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:48.223792] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:48.223861] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:48.223955] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:48.223998] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:48.224037] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:48.224080] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:48.224148] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:48.224192] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:48.224271] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:48.224315] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042066-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:48.230870] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D480-0-0] [lt=15] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:48.244781] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:48.244823] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:48.245266] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:48.245291] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=495, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:48.245308] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=30, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:48.246840] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=35] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:48.248620] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=36] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:48.248734] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526802034000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:48.260720] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.265397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283402399744, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:48.267773] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219528267608000, start_id=1719219528267608000, end_id=1719219528267608001) [2024-06-24 16:58:48.273178] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=11] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:48.273208] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=25] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:48.273228] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:48.273246] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:48.279573] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:48.279598] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] try gc retain ctx [2024-06-24 16:58:48.279646] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=10] get_max_applied_scn(scn={val:1719219527861214002, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32445180}, palf_committed_end_scn_:{val:1719219527861214002, v:0}, last_check_scn_:{val:1719219527861214002, v:0}, max_applied_cb_scn_:{val:1719219527861214002, v:0}}) [2024-06-24 16:58:48.279682] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:48.282060] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=106] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219525564193000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219536480480000, latest_log_ts:{val:1719219519847687001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:48.282187] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=108] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:48.282214] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:48.282269] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E3-0-0] [lt=21] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:48.282300] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E3-0-0] [lt=26] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:48.282267] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:48.282328] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=60] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:48.282527] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=327, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:48.282544] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=10, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:48.282565] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:48.282597] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=395, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:48.282614] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=32, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:48.281301] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=16] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854 [2024-06-24 16:58:48.283197] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1892] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:48.284479] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219525564193000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:48.284578] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=88] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:48.284600] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:48.284982] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=345, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:48.285018] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:48.285038] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:48.285042] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.285057] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=409, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:48.285072] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=20, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:48.327101] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112223, mem_used=264127488) [2024-06-24 16:58:48.329120] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219528328646000, start_id=1719219528328646000, end_id=1719219528328646001) [2024-06-24 16:58:48.343939] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:48.354743] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76AC-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.354772] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219528353896000, start_id=1719219528353896000, end_id=1719219528353896001) [2024-06-24 16:58:48.357580] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76AE-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.360782] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.362120] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219528361265000, start_id=1719219528361265000, end_id=1719219528361265001) [2024-06-24 16:58:48.362163] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=389, get_gts_with_stc_cnt=31, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:48.362187] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:48.363245] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075885-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.366035] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76B9-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.368842] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76BB-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.372664] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:48.372700] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:48.385100] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.389154] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B0-0-0] [lt=44][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:48.389187] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B0-0-0] [lt=32][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:48.393127] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219528392928000, start_id=1719219528392928000, end_id=1719219528392928001) [2024-06-24 16:58:48.393471] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76DF-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.395477] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=36] LogLoopThread round_cost_time(us)(round_cost_time=16) [2024-06-24 16:58:48.396247] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76E1-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:48.400965] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82600000, replace_num=100000) [2024-06-24 16:58:48.400994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:48.401110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76E6-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:48.403352] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:48.403449] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:48.403647] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:48.403704] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:48.403853] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:48.403919] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:48.404011] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A76EB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:48.407958] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D446-0-0] [lt=27] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:48.410232] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0420F3-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.415229] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219528415092000, start_id=1719219528415092000, end_id=1719219528415092001) [2024-06-24 16:58:48.421660] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129847, mem_used=326519808) [2024-06-24 16:58:48.452364] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:48.453131] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10758F8-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:48.454550] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=31] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:48.454602] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=46] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:48.454657] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=47] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:48.454814] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=27] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219525858204001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:48.454934] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=114] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:48.454986] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=44] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:48.455008] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219527359914001, v:0}) [2024-06-24 16:58:48.455022] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:48.455050] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:48.455080] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:48.455106] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:48.456067] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7741-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.457222] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:48.457251] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=29] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:48.457284] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=30] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:48.457516] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=24] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219525858204001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:48.457628] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=100] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:48.457645] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:48.457666] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:48.457688] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:48.457707] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:48.457718] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=10] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:48.460843] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.465019] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=8] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:48.465056] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=30] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:48.465076] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:48.465093] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:48.465901] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283398205440, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:48.466548] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2024-06-24 16:58:48.467880] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219528466823000, start_id=1719219528466823000, end_id=1719219528466823001) [2024-06-24 16:58:48.467959] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:48.467994] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:48.468355] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=356, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:48.468387] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:48.468407] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:48.468432] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=415, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:48.468448] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=24, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:48.471750] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=11] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:48.472046] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=293] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:48.474754] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=57] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:48.474780] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=25] try gc retain ctx [2024-06-24 16:58:48.474816] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=10] get_max_applied_scn(scn={val:1719219528415092000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70382923}, palf_committed_end_scn_:{val:1719219528466823000, v:0}, last_check_scn_:{val:1719219528466823000, v:0}, max_applied_cb_scn_:{val:1719219528415092000, v:0}}) [2024-06-24 16:58:48.474850] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=30] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:48.477328] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=103] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:48.479725] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1089, avg_group_log_size=121) [2024-06-24 16:58:48.479758] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1089) [2024-06-24 16:58:48.480147] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1089) [2024-06-24 16:58:48.481970] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:48.483663] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [162935][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=32][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:48.483764] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [162935][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=31][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:48.485159] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.489960] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:48.491748] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=33] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:48.491849] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526749170000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:48.508532] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7782-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:48.517837] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E940-0-0] [lt=19] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1719219528517817}) [2024-06-24 16:58:48.517890] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06B-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219528517857, sql_renew_time:1719219528517857, is_mark_fail:false}]) [2024-06-24 16:58:48.517942] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06B-0-0] [lt=50] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1719219528517817}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219528517857, sql_renew_time:1719219528517857, is_mark_fail:false}]) [2024-06-24 16:58:48.520223] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E940-0-0] [lt=34] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:48.520417] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E940-0-0] [lt=35][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:48.528183] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=20] ls blacklist refresh finish(cost_time=12079) [2024-06-24 16:58:48.529262] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219528529162000, start_id=1719219528529162000, end_id=1719219528529162001) [2024-06-24 16:58:48.529765] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3411) [2024-06-24 16:58:48.529808] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3411) [2024-06-24 16:58:48.529970] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219528328646000, v:0}, new_max_version={val:1719219528328646000, v:0}, last_min_version={val:1719219528128315000, v:0}, last_max_version={val:1719219528128315000, v:0}, total_time_us=2667, delta_us=201322) [2024-06-24 16:58:48.530004] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219528328646000, v:0}, min_version={val:1719219528328646000, v:0}, max_version={val:1719219528328646000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:48.546132] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=22] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:48.554905] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=11] get number(ret=0, service_type_=0, range=1, base_id=1719219528554483000, start_id=1719219528554483000, end_id=1719219528554483001) [2024-06-24 16:58:48.560892] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.569091] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A10-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219528568202000, start_id=1719219528568202000, end_id=1719219528568202001) [2024-06-24 16:58:48.580191] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=368, avg_log_submit_to_slide_time=377) [2024-06-24 16:58:48.585215] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.585495] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=51] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:48.589516] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D430-0-0] [lt=33] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:48.593230] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219528592495000, start_id=1719219528592495000, end_id=1719219528592495001) [2024-06-24 16:58:48.593164] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1969] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:66, min_worker_cnt:42, max_worker_cnt:150, stopped:0, worker_us:368183806, recv_hp_rpc_cnt:3238, recv_np_rpc_cnt:3446, recv_lp_rpc_cnt:0, recv_mysql_cnt:32259, recv_task_cnt:51, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:24977052, workers:42, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=128 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:25086, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213256365800}{group_id:10, queue_size:0, recv_req_cnt:6265, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213261360250}{group_id:20, queue_size:0, recv_req_cnt:965, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918743789}{group_id:15, queue_size:0, recv_req_cnt:13, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216919852802}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213258715738}{group_id:9, queue_size:0, recv_req_cnt:160, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213252335182}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=2, token_change_ts:1719213259025542, tenant_role:1}) [2024-06-24 16:58:48.595199] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=2034] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245340110, is_removed:false}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:80631015, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:1385, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:31194622, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info: pcode=0x5c0:cnt=4, token_change_ts:1719213259035589, tenant_role:0}) [2024-06-24 16:58:48.597142] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1942] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245333314, is_removed:false}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:44767634, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:15596155, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1719213259048104, tenant_role:0}) [2024-06-24 16:58:48.600708] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:227) [162289][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=31] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=0) [2024-06-24 16:58:48.599009] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1866] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:24522073, recv_hp_rpc_cnt:74, recv_np_rpc_cnt:6104, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2475962, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24810, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213325131824}{group_id:20, queue_size:0, recv_req_cnt:641, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215168816313}{group_id:5, queue_size:0, recv_req_cnt:22, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213327935283}, rpc_stat_info: pcode=0x150b:cnt=21 pcode=0x150a:cnt=21 pcode=0x745:cnt=10, token_change_ts:1719213324836532, tenant_role:1}) [2024-06-24 16:58:48.601079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:48.600960] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1950] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:150, stopped:0, worker_us:6441672304, recv_hp_rpc_cnt:2104, recv_np_rpc_cnt:7, recv_lp_rpc_cnt:0, recv_mysql_cnt:17608316, recv_task_cnt:354, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:43620329, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49498, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213333985763}{group_id:20, queue_size:0, recv_req_cnt:1946, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215769388477}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918841349}, rpc_stat_info: pcode=0x150a:cnt=40 pcode=0x150b:cnt=40, token_change_ts:1719213324547495, tenant_role:1}) [2024-06-24 16:58:48.603092] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1A-0-0] [lt=18][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103424694459, cache_obj->added_lc()=false, cache_obj->get_object_id()=9372, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:48.602900] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1939] dump tenant info(tenant={id:1003, tenant_meta:{unit:{tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1003, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:27141705, recv_hp_rpc_cnt:57, recv_np_rpc_cnt:6080, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2465875, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24704, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213351914771}{group_id:20, queue_size:0, recv_req_cnt:564, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216369834163}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213354638840}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1719213351641415, tenant_role:1}) [2024-06-24 16:58:48.604830] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1930] dump tenant info(tenant={id:1004, tenant_meta:{unit:{tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1004, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:184, stopped:0, worker_us:184873520, recv_hp_rpc_cnt:5103, recv_np_rpc_cnt:1397, recv_lp_rpc_cnt:0, recv_mysql_cnt:40509, recv_task_cnt:15, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:9897148, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49282, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213361134602}{group_id:20, queue_size:0, recv_req_cnt:3494, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216969504568}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918851855}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x51f:cnt=4, token_change_ts:1719217153282307, tenant_role:1}) [2024-06-24 16:58:48.610405] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] ====== tenant freeze timer task ====== [2024-06-24 16:58:48.615363] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219528614664000, start_id=1719219528614664000, end_id=1719219528614664001) [2024-06-24 16:58:48.621553] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=15] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:48.621586] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:48.645447] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=430, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:48.645484] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:48.649667] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219528649663, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-06-24 16:58:48.651250] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=25] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13754, offset=3454820}, end_cursor:ObLogCursor{file_id=1, log_id=13755, offset=3455093}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d1c050, len:2204, log_data_len:273, seq:13754, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:48.654167] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D917-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219528653744000, start_id=1719219528653744000, end_id=1719219528653744001) [2024-06-24 16:58:48.654245] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D917-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8375, avg_group_log_size=492) [2024-06-24 16:58:48.654272] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D917-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8375) [2024-06-24 16:58:48.654634] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8375) [2024-06-24 16:58:48.654691] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8375) [2024-06-24 16:58:48.654736] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=400, avg_log_submit_to_slide_time=411) [2024-06-24 16:58:48.655269] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=35] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13755, offset=3455093}, end_cursor:ObLogCursor{file_id=1, log_id=13756, offset=3455358}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d20050, len:1931, log_data_len:265, seq:13755, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:48.657571] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB APPEND COST TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=32, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:48.657603] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=405, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:48.657619] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:48.657651] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=31] [APPLY STAT CB EXECUTE TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=-443, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:48.657665] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=-5, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:48.660953] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.666432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283398205440, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:48.668067] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219528667493000, start_id=1719219528667493000, end_id=1719219528667493001) [2024-06-24 16:58:48.673138] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=340, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:48.673156] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:48.673141] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:48.673190] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:48.673217] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=403, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:48.673237] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:48.673338] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7875-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.676490] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A05-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.682292] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A07-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.685274] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.685380] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A788B-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.688545] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A788D-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.700574] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=17] gc stale ls task succ [2024-06-24 16:58:48.713464] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD57-0-0] [lt=28] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:48.714667] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A78B1-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.717790] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A78B3-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:48.721620] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [162333][Blacklist][T0][Y0-0000000000000000-0-0] [lt=37] blacklist_loop exec finished(cost_time=47, is_enabled=true, send_cnt=0) [2024-06-24 16:58:48.722326] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0421F4-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:48.725146] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:48.725253] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:48.725459] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:48.725521] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:48.725699] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:48.725775] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:48.725879] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A40-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:48.729383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219528728685000, start_id=1719219528728685000, end_id=1719219528728685001) [2024-06-24 16:58:48.729469] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3996, avg_group_log_size=399) [2024-06-24 16:58:48.729499] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3533) [2024-06-24 16:58:48.730959] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=21] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:48.731073] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D446-0-0] [lt=23] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:48.732292] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A47-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.745282] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:48.747057] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:48.747168] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526812609000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:48.755035] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219528753977000, start_id=1719219528753977000, end_id=1719219528753977001) [2024-06-24 16:58:48.761015] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.763287] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=33366, mem_used=139342848) [2024-06-24 16:58:48.763590] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A18-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219528763495000, start_id=1719219528763495000, end_id=1719219528763495001) [2024-06-24 16:58:48.763676] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A18-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=2883, avg_group_log_size=288) [2024-06-24 16:58:48.763700] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A18-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2548) [2024-06-24 16:58:48.763803] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A68-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219528763495000, start_id=1719219528763495001, end_id=1719219528763495002) [2024-06-24 16:58:48.763874] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7905-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219528763495000, start_id=1719219528763495002, end_id=1719219528763495003) [2024-06-24 16:58:48.764063] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=2883) [2024-06-24 16:58:48.764107] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=2883) [2024-06-24 16:58:48.764149] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=382, avg_log_submit_to_slide_time=391) [2024-06-24 16:58:48.764891] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [163815][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:48.764997] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [163815][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2024-06-24 16:58:48.769964] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A790B-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:48.772825] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075A72-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.773597] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=9] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:48.773634] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:48.773675] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=465, avg_log_submit_to_slide_time=475) [2024-06-24 16:58:48.773690] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=20] [APPLY STAT CB APPEND COST TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=28, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:48.773716] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=24] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=451, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:48.773732] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:48.773746] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=-517, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:48.773760] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=-36, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:48.774257] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:48.776041] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=37] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:48.776143] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219527132319000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:48.783305] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=39] new mysql sessid created(conn.sessid_=3221494481, support_ssl=false) [2024-06-24 16:58:48.783390] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=33] sm conn init succ(conn.sessid_=3221494481, sess.client_addr_="172.20.17.86:49532") [2024-06-24 16:58:48.783416] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494481, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:48.783462] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494481, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:48.783494] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221494481, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:48.783511] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494481, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:48.783535] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494481) [2024-06-24 16:58:48.783548] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162500][sql_nio10][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494481, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:48.785332] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.793363] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219528792973000, start_id=1719219528792973000, end_id=1719219528792973001) [2024-06-24 16:58:48.793437] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:48.793470] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:48.793895] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=375, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:48.793932] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=13, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:48.793956] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:48.793975] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=438, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:48.793991] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=26, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:48.795763] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:91337, max_lsn:70386335, max_scn:{val:1719219528667493001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:70386335}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:28443295}}, last_submit_lsn:{lsn:70386213}, last_submit_end_lsn:{lsn:70386335}, last_submit_log_id:91337, last_submit_log_pid:1, max_flushed_lsn:{lsn:70386213}, max_flushed_end_lsn:{lsn:70386335}, max_flushed_log_pid:1, committed_end_lsn:{lsn:70386335}, last_slide_log_id:91337, last_slide_scn:{val:1719219528667493001, v:0}, last_slide_lsn:{lsn:70386213}, last_slide_end_lsn:{lsn:70386335}, last_slide_log_pid:1, last_slide_log_accum_checksum:2143746696, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4755346530}, [StateMgr]={this:0x7f475534a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:91338, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213327209529, palf_role_change_cb:0x7f4755350cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4755347c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/meta", dir_fd:666, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f475534c478, flashback_version:0}, log_storage:{log_tail:{lsn:70386335}, readable_log_tail:{lsn:70386335}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719219133216967001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/log", dir_fd:667, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:63823201, block_header_serialize_buf_:0x7f475534e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213327209030, this:0x7f475534a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213327209993, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f475534a430}) [2024-06-24 16:58:48.796117] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=349] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219528776155, last_flushed_end_lsn:{lsn:70386335}}]) [2024-06-24 16:58:48.796145] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=91338, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219528776155, last_flushed_end_lsn:{lsn:70386335}}]) [2024-06-24 16:58:48.796614] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0017-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219528796147000, start_id=1719219528796147000, end_id=1719219528796147001) [2024-06-24 16:58:48.801176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:48.812193] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=12] ====== check clog disk timer task ====== [2024-06-24 16:58:48.812218] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:48.812243] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=13] cannot_recycle_log_size statistics(cannot_recycle_log_size=53507205, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:48.815443] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219528815174000, start_id=1719219528815174000, end_id=1719219528815174001) [2024-06-24 16:58:48.821667] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075ABC-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:48.827089] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=18] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=50, mem_used=49913856) [2024-06-24 16:58:48.827132] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=27] release old cannot free more memory [2024-06-24 16:58:48.827148] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=60, size_used=0, mem_used=49913856) [2024-06-24 16:58:48.857952] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=28] current monitor number(seq_=-1) [2024-06-24 16:58:48.861074] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:48.861106] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=31] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:48.861124] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.862993] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219528862689000, start_id=1719219528862689000, end_id=1719219528862689001) [2024-06-24 16:58:48.866971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283396108288, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:48.868140] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219528867974000, start_id=1719219528867974000, end_id=1719219528867974001) [2024-06-24 16:58:48.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.873833] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.873833] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874123] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874188] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874407] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874417] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874509] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874538] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874660] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874664] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874668] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874699] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874695] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874705] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874714] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874762] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874820] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.874881] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:48.885389] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.912137] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:48.929551] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219528929196000, start_id=1719219528929196000, end_id=1719219528929196001) [2024-06-24 16:58:48.947292] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=23] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:48.955134] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219528954491000, start_id=1719219528954491000, end_id=1719219528954491001) [2024-06-24 16:58:48.961132] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.961471] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=25] ====== tenant freeze timer task ====== [2024-06-24 16:58:48.968506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC12A0A-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.971500] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075B70-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:48.973025] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:48.973078] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:48.973121] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:48.973157] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:48.973208] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:48.973486] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:48.973528] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=416, avg_log_submit_to_slide_time=430) [2024-06-24 16:58:48.973722] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=388, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:48.977804] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A38-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:48.980889] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075B7B-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:48.984034] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A40-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:48.985446] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:48.996991] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219528996568000, start_id=1719219528996568000, end_id=1719219528996568001) [2024-06-24 16:58:48.997074] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:48.997101] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7764) [2024-06-24 16:58:48.997458] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:48.997512] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7764) [2024-06-24 16:58:48.997549] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=413, avg_log_submit_to_slide_time=426) [2024-06-24 16:58:49.001271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:49.003458] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:49.004514] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=27] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261355958272) [2024-06-24 16:58:49.007467] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=44] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:49.009146] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075BA0-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:49.010780] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16507, offset=3761565}, end_cursor:ObLogCursor{file_id=1, log_id=16508, offset=3761838}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d24050, len:2659, log_data_len:273, seq:16507, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:49.012207] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075BA1-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.014822] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D908-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219529014529000, start_id=1719219529014529000, end_id=1719219529014529001) [2024-06-24 16:58:49.015619] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219529015586000, start_id=1719219529015586000, end_id=1719219529015586001) [2024-06-24 16:58:49.015867] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16508, offset=3761838}, end_cursor:ObLogCursor{file_id=1, log_id=16509, offset=3762103}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d28050, len:2386, log_data_len:265, seq:16508, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:49.017170] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042300-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.019843] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:49.019926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:49.020011] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1719219529020008, bytes: 170981852, bw: 0.019928 MB/s, add_ts: 1007620, add_bytes: 21055 [2024-06-24 16:58:49.020075] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:49.020121] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:49.020245] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:49.020298] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:49.020370] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7A77-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:49.032028] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075BB7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:49.036404] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:49.036437] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:49.036472] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=348868692, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:49.045714] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=420, avg_log_submit_to_slide_time=436) [2024-06-24 16:58:49.055895] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:49.058507] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 354.50) [2024-06-24 16:58:49.058526] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:49.058595] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 384.00) [2024-06-24 16:58:49.058604] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:49.058635] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058645] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058651] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058691] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058700] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058710] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058715] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058725] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058734] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=8] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058741] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058749] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058755] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058760] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=5] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058766] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058774] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.058781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:49.061180] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.067269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7ABF-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.067463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283394011136, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:49.068261] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219529067329000, start_id=1719219529067329000, end_id=1719219529067329001) [2024-06-24 16:58:49.069698] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7AC1-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:49.085508] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.087098] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=18320666, clean_num=201326) [2024-06-24 16:58:49.095729] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096233] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.096651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097312] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097438] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1093, mem_used=2079744) [2024-06-24 16:58:49.097483] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097543] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097551] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097557] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097690] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097704] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097765] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097816] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097843] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097889] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097915] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097946] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097945] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.097970] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098078] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098180] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098327] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098421] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098483] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098642] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098658] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098676] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098696] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.098709] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.115758] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7B08-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.129270] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219529128509000, start_id=1719219529128509000, end_id=1719219529128509001) [2024-06-24 16:58:49.134420] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=22] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1, avail_memory=912680550, chunk_count_=0, avail_sort_memory_=912680550, avail_memory_=912680550) [2024-06-24 16:58:49.135040] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:49.155147] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138A5-0-0] [lt=15] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336819486618041992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.884401192498512501e+01) [2024-06-24 16:58:49.155270] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219529154963000, start_id=1719219529154963000, end_id=1719219529154963001) [2024-06-24 16:58:49.161240] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.170684] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E5-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:49.170721] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E5-0-0] [lt=33] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:49.171807] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D900-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:49.171841] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D900-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:49.173175] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:49.173559] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:49.173604] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:49.173656] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=477, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:49.173675] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:49.176177] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=25] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:49.180512] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1089) [2024-06-24 16:58:49.185609] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:49.185647] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:49.185674] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.193555] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219529192973000, start_id=1719219529192973000, end_id=1719219529192973001) [2024-06-24 16:58:49.201366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:49.202142] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:49.215227] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] get number(ret=0, service_type_=0, range=1, base_id=1719219529215183000, start_id=1719219529215183000, end_id=1719219529215183001) [2024-06-24 16:58:49.215788] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:49.245417] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:49.245475] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:49.245973] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:49.246004] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=459, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:49.246019] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=38, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:49.261296] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.261584] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=43] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:49.268372] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219529268033000, start_id=1719219529268033000, end_id=1719219529268033001) [2024-06-24 16:58:49.277209] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075CD3-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:49.280208] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7BD3-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:49.285643] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.285810] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075CDC-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:49.287604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283394011136, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:49.288686] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075CDD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:49.291674] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0423D8-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:49.293970] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=19] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=526340096, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=547401728, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:49.294085] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=49] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:49.294115] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=27] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:49.294189] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=145041, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373857526, tmp_max_wa_memory_size=373857527, pre_mem_target=373712486, remain_memory_size=373712486, ratio=6.916093826293945312e-02, alloc_ratio=3.879579506232597695e-04, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1646419968, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5869772800, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:49.294271] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46732190, calc_global_bound_size=1048576000000, mem_target_=373857526, wa_max_memory_size=373857526, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373857526, avg_bound_size=186928763, max_bound_size=46732190, min_bound_size_=1048576) [2024-06-24 16:58:49.294291] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, global_bound_size_=46732190, manual_calc_cnt_=417075, drift_size_=0, pre_drift_size=18360336, wa_max_memory_size=373857526, sql_mem_callback_.get_total_alloc_size()=145041, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46732190, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373857526, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:49.294359] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:49.294441] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:49.294459] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=18] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:49.294534] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:49.294691] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=28] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:49.294714] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:49.301666] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:49.301689] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:49.301720] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=70390116, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:49.316226] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075CFB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:49.316823] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:49.316863] INFO [COMMON] handle (memory_dump.cpp:552) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:49.317152] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] update_check_range(min_check_version=622, max_check_version=624, global_version=625) [2024-06-24 16:58:49.319187] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075CFC-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.323677] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075D00-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.326228] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:49.326342] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:49.326554] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:49.326636] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:49.326816] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:49.326896] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:49.327004] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C17-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:49.327243] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112256, mem_used=264127488) [2024-06-24 16:58:49.329335] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219529329267000, start_id=1719219529329267000, end_id=1719219529329267001) [2024-06-24 16:58:49.331155] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=17] ====== tenant freeze timer task ====== [2024-06-24 16:58:49.333541] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075D0C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:49.333638] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD109-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219529333502000, start_id=1719219529333502000, end_id=1719219529333502001) [2024-06-24 16:58:49.333684] INFO [LIB] stat (utility.h:1165) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD109-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:49.333706] INFO [LIB] stat (utility.h:1165) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD109-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:49.334066] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=341, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:49.334108] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:49.334135] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:49.334168] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=425, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:49.334187] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=23, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:49.334447] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0423FA-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219529333502000, start_id=1719219529333502001, end_id=1719219529333502002) [2024-06-24 16:58:49.339954] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A1F-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219529339891000, start_id=1719219529339891000, end_id=1719219529339891001) [2024-06-24 16:58:49.342189] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C36-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219529342021000, start_id=1719219529342021000, end_id=1719219529342021001) [2024-06-24 16:58:49.344064] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:49.348428] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=23] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:49.356375] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219529355780000, start_id=1719219529355780000, end_id=1719219529355780001) [2024-06-24 16:58:49.361356] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.363823] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219529363182000, start_id=1719219529363182000, end_id=1719219529363182001) [2024-06-24 16:58:49.363874] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:49.373061] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C57-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.373314] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:49.373349] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:49.375918] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C58-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:49.380270] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:49.380307] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:49.380656] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=364, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:49.380689] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:49.380711] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:49.380727] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=426, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:49.380742] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=22, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:49.385703] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.393671] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219529392747000, start_id=1719219529392747000, end_id=1719219529392747001) [2024-06-24 16:58:49.399526] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B1-0-0] [lt=47][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:49.399550] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B1-0-0] [lt=22][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:49.401453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:49.415382] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219529414923000, start_id=1719219529414923000, end_id=1719219529414923001) [2024-06-24 16:58:49.421793] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129855, mem_used=326519808) [2024-06-24 16:58:49.426276] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7C9C-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.439834] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] ====== checkpoint timer task ====== [2024-06-24 16:58:49.442029] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=29] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:49.442075] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=44] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:49.442119] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:49.442261] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:49.442385] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=118] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:49.442415] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:49.442437] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219521210793001, v:0}) [2024-06-24 16:58:49.442451] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:49.442465] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:49.442484] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:49.442518] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:49.442543] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:49.442559] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:49.461414] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.468511] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219529467845000, start_id=1719219529467845000, end_id=1719219529467845001) [2024-06-24 16:58:49.468586] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:49.468639] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:49.469011] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=412, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:49.469040] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:49.469055] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=5, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:49.469071] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=468, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:49.469080] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=8] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=18, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:49.480798] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1098) [2024-06-24 16:58:49.482083] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:49.485762] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.488139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283391913984, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:49.491998] INFO handle (memory_dump.cpp:679) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] statistics: tenant_cnt: 8, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 270 257 0 1 2 65 1 0 1 4 1 1 0 1 5 67 4 0 1 7 1 2 0 1 8 72 1 0 1 12 7 3 0 1 13 7 1 0 1 14 1 2 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 1 22 1 1 0 500 0 105 232 0 500 7 4 4 0 500 8 85 1 0 500 9 5 1 0 500 10 6 2 0 500 16 3 1 0 500 17 37 7 0 500 22 90 62 0 500 23 69 11 0 508 0 5 11 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 90 221 0 1001 2 22 1 0 1001 4 1 1 0 1001 5 19 4 0 1001 8 45 1 0 1001 12 4 3 0 1001 13 2 1 0 1001 14 1 2 0 1001 18 7 3 0 1001 20 1 1 0 1002 0 215 250 0 1002 2 201 1 0 1002 4 1 1 0 1002 5 109 4 0 1002 6 1 2 0 1002 8 59 1 0 1002 12 14 3 0 1002 13 9 1 0 1002 14 1 2 0 1002 18 7 3 0 1002 20 1 1 0 1003 0 125 225 0 1003 2 22 1 0 1003 4 1 1 0 1003 5 30 4 0 1003 8 47 1 0 1003 12 5 3 0 1003 13 2 1 0 1003 14 1 2 0 1003 18 6 3 0 1003 20 1 1 0 1004 0 320 249 0 1004 2 95 1 0 1004 4 1 1 0 1004 5 71 4 0 1004 8 60 1 0 1004 12 17 3 0 1004 13 10 1 0 1004 14 1 2 0 1004 18 6 3 0 1004 20 1 1 0 cost_time: 174912 [2024-06-24 16:58:49.492040] INFO [LIB] operator() (ob_malloc_allocator.cpp:542) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 18,253,611,008 hold: 1,576,955,904 rpc_hold: 0 cache_hold: 232,783,872 cache_used: 232,783,872 cache_item_count: 111 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 834,543,616 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 136,314,880 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 140,509,184 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 150,994,944 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 14,680,064 limit= 3,650,722,200 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 6,311,936 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2024-06-24 16:58:49.492428] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 834,543,616 used= 729,295,552 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 344,293,376 used= 344,138,432 count= 129 avg_used= 2,667,739 block_cnt= 129 chunk_cnt= 129 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 38,563,840 used= 38,535,392 count= 2 avg_used= 19,267,696 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 37,769,216 used= 37,748,856 count= 1 avg_used= 37,748,856 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 24,727,552 used= 24,661,440 count= 39 avg_used= 632,344 block_cnt= 39 chunk_cnt= 22 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 18,800,640 used= 17,629,680 count= 255 avg_used= 69,136 block_cnt= 255 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 16,797,696 used= 16,777,336 count= 1 avg_used= 16,777,336 block_cnt= 1 chunk_cnt= 1 mod=MrgMemPoolChk [MEMORY] hold= 15,014,736 used= 14,885,937 count= 98 avg_used= 151,897 block_cnt= 37 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 12,492,800 used= 12,451,840 count= 2 avg_used= 6,225,920 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,257,536 used= 8,240,064 count= 2 avg_used= 4,120,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 6,862,480 used= 6,837,464 count= 70 avg_used= 97,678 block_cnt= 70 chunk_cnt= 12 mod=TabletMap [MEMORY] hold= 6,381,568 used= 5,627,904 count= 92 avg_used= 61,172 block_cnt= 92 chunk_cnt= 23 mod=[T]char [MEMORY] hold= 6,148,096 used= 6,131,072 count= 1 avg_used= 6,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,601,152 used= 4,530,096 count= 978 avg_used= 4,632 block_cnt= 978 chunk_cnt= 33 mod=WorkerMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 6 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,883,008 used= 3,841,152 count= 6 avg_used= 640,192 block_cnt= 6 chunk_cnt= 2 mod=TransTimeWheel [MEMORY] hold= 3,883,008 used= 3,841,152 count= 6 avg_used= 640,192 block_cnt= 6 chunk_cnt= 3 mod=XATimeWheel [MEMORY] hold= 3,842,048 used= 3,820,032 count= 2 avg_used= 1,910,016 block_cnt= 2 chunk_cnt= 2 mod=LDBlockBitMap [MEMORY] hold= 3,763,584 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 13 mod=CkptDgnMemCU [MEMORY] hold= 3,763,584 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 14 mod=CkptDgnMem [MEMORY] hold= 3,723,264 used= 3,698,688 count= 2 avg_used= 1,849,344 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 6 mod=SqlDtlQueue [MEMORY] hold= 2,711,552 used= 2,693,824 count= 1 avg_used= 2,693,824 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,864 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,097,152 used= 2,093,056 count= 32 avg_used= 65,408 block_cnt= 32 chunk_cnt= 12 mod=StorMetaCacheIO [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 2 mod=DagMap [MEMORY] hold= 1,777,664 used= 1,770,696 count= 1 avg_used= 1,770,696 block_cnt= 1 chunk_cnt= 1 mod=TableProc [MEMORY] hold= 1,681,536 used= 1,666,560 count= 205 avg_used= 8,129 block_cnt= 205 chunk_cnt= 23 mod=ParamCharsType [MEMORY] hold= 1,584,288 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,269,184 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 2 mod=PoolFreeList [MEMORY] hold= 1,253,376 used= 1,114,112 count= 17 avg_used= 65,536 block_cnt= 17 chunk_cnt= 8 mod=MinorMergeMgr [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 950,272 used= 508,544 count= 58 avg_used= 8,768 block_cnt= 58 chunk_cnt= 20 mod=[T]ObDSActionAr [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 920,000 used= 912,640 count= 115 avg_used= 7,936 block_cnt= 115 chunk_cnt= 22 mod=QueryAllocator [MEMORY] hold= 829,632 used= 804,864 count= 258 avg_used= 3,119 block_cnt= 130 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 819,200 used= 804,640 count= 5 avg_used= 160,928 block_cnt= 5 chunk_cnt= 5 mod=SQLSessionInfo [MEMORY] hold= 802,944 used= 786,432 count= 256 avg_used= 3,072 block_cnt= 128 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 794,624 used= 786,440 count= 1 avg_used= 786,440 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 794,624 used= 786,440 count= 1 avg_used= 786,440 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 786,560 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 2 mod=LogAlloc [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 576,128 used= 571,392 count= 72 avg_used= 7,936 block_cnt= 72 chunk_cnt= 22 mod=GlobalIter [MEMORY] hold= 566,784 used= 558,912 count= 123 avg_used= 4,544 block_cnt= 123 chunk_cnt= 22 mod=[T]ObTraceEvent [MEMORY] hold= 462,384 used= 458,736 count= 57 avg_used= 8,048 block_cnt= 57 chunk_cnt= 20 mod=[T]ObPerfEventR [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 393,216 used= 376,752 count= 6 avg_used= 62,792 block_cnt= 6 chunk_cnt= 6 mod=CommSysVarFac [MEMORY] hold= 385,024 used= 377,120 count= 1 avg_used= 377,120 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 2 mod=bf_queue [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 272,000 used= 269,824 count= 34 avg_used= 7,936 block_cnt= 34 chunk_cnt= 7 mod=LinearHashMapNo [MEMORY] hold= 262,144 used= 261,632 count= 4 avg_used= 65,408 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 240,000 used= 238,080 count= 30 avg_used= 7,936 block_cnt= 30 chunk_cnt= 5 mod=LockWaitMgr [MEMORY] hold= 212,992 used= 212,160 count= 1 avg_used= 212,160 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 200,704 used= 196,608 count= 64 avg_used= 3,072 block_cnt= 32 chunk_cnt= 4 mod=TxCtxMgr [MEMORY] hold= 181,440 used= 178,560 count= 45 avg_used= 3,968 block_cnt= 23 chunk_cnt= 6 mod=TinyAllocator [MEMORY] hold= 168,000 used= 166,656 count= 21 avg_used= 7,936 block_cnt= 21 chunk_cnt= 12 mod=LSIter [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=MemtableSetBkt [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 106,496 used= 98,432 count= 1 avg_used= 98,432 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 98,304 used= 97,760 count= 1 avg_used= 97,760 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 7 mod=SqlSession [MEMORY] hold= 88,000 used= 87,296 count= 11 avg_used= 7,936 block_cnt= 11 chunk_cnt= 8 mod=PartCtx [MEMORY] hold= 81,920 used= 65,536 count= 2 avg_used= 32,768 block_cnt= 2 chunk_cnt= 1 mod=CsDictPl [MEMORY] hold= 78,720 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 7 mod=HashNodeLCSta [MEMORY] hold= 78,720 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 6 mod=TabletIDSetNode [MEMORY] hold= 74,960 used= 36,624 count= 523 avg_used= 70 block_cnt= 159 chunk_cnt= 32 mod=Coro [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoMgr [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 72,768 used= 71,424 count= 7 avg_used= 10,203 block_cnt= 7 chunk_cnt= 4 mod=NotParamInfo [MEMORY] hold= 72,240 used= 1,024 count= 896 avg_used= 1 block_cnt= 10 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 72,000 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 8 mod=SqlSessiVarMap [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 56,832 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 49,152 used= 49,088 count= 1 avg_used= 49,088 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 48,832 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 48,784 used= 44,792 count= 2 avg_used= 22,396 block_cnt= 2 chunk_cnt= 2 mod=Autoincrement [MEMORY] hold= 48,000 used= 47,616 count= 6 avg_used= 7,936 block_cnt= 6 chunk_cnt= 6 mod=PlanVaIdx [MEMORY] hold= 45,632 used= 41,664 count= 62 avg_used= 672 block_cnt= 29 chunk_cnt= 12 mod=[T]ObWarningBuf [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=ConstPl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=CsStrPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=CsIntPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=RawPl [MEMORY] hold= 40,960 used= 32,768 count= 1 avg_used= 32,768 block_cnt= 1 chunk_cnt= 1 mod=DictPl [MEMORY] hold= 40,000 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 2 mod=ObDMMDL [MEMORY] hold= 40,000 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 4 mod=MdsTableMgr [MEMORY] hold= 39,360 used= 39,040 count= 5 avg_used= 7,808 block_cnt= 5 chunk_cnt= 4 mod=HashNodePlanCac [MEMORY] hold= 35,200 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 10 chunk_cnt= 6 mod=CACHE_INST [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 25,664 count= 1 avg_used= 25,664 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 32,768 used= 17,408 count= 2 avg_used= 8,704 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTTP [MEMORY] hold= 32,576 used= 25,103 count= 2 avg_used= 12,551 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 31,680 used= 27,456 count= 66 avg_used= 416 block_cnt= 32 chunk_cnt= 7 mod=OMT_Worker [MEMORY] hold= 31,424 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 25,264 used= 6,120 count= 255 avg_used= 24 block_cnt= 97 chunk_cnt= 20 mod=[T]MemoryContex [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=RlePl [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,576 used= 16,384 count= 1 avg_used= 16,384 block_cnt= 1 chunk_cnt= 1 mod=IntDiffPl [MEMORY] hold= 24,240 used= 20,136 count= 2 avg_used= 10,068 block_cnt= 2 chunk_cnt= 2 mod=TabletStats [MEMORY] hold= 24,208 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 24,000 used= 23,808 count= 3 avg_used= 7,936 block_cnt= 3 chunk_cnt= 1 mod=TableScanIter [MEMORY] hold= 23,904 used= 23,712 count= 3 avg_used= 7,904 block_cnt= 3 chunk_cnt= 2 mod=SqlSessionSbloc [MEMORY] hold= 23,568 used= 23,376 count= 3 avg_used= 7,792 block_cnt= 3 chunk_cnt= 3 mod=CkptDgnMemNode [MEMORY] hold= 20,160 used= 19,840 count= 5 avg_used= 3,968 block_cnt= 4 chunk_cnt= 3 mod=CkpDgn [MEMORY] hold= 18,320 used= 16,896 count= 22 avg_used= 768 block_cnt= 22 chunk_cnt= 8 mod=TGTimer [MEMORY] hold= 16,768 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 3 chunk_cnt= 2 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ColSubStrPl [MEMORY] hold= 16,384 used= 13,824 count= 1 avg_used= 13,824 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ColEqualPl [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TblCtxIMgr [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=StrPrefixPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=HexStrPl [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=StrDiffPl [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 2 mod=TltMemtablMgr [MEMORY] hold= 15,712 used= 15,584 count= 2 avg_used= 7,792 block_cnt= 2 chunk_cnt= 1 mod=CkptDgnCUNode [MEMORY] hold= 11,728 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 1 mod=StopWordSet [MEMORY] hold= 10,240 used= 10,112 count= 2 avg_used= 5,056 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 9,216 used= 9,080 count= 2 avg_used= 4,540 block_cnt= 2 chunk_cnt= 2 mod=GCMemtableMap [MEMORY] hold= 9,120 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 1 mod=FTPluginMap [MEMORY] hold= 8,320 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,320 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 7,968 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,792 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,776 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,696 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 5,184 used= 5,120 count= 1 avg_used= 5,120 block_cnt= 1 chunk_cnt= 1 mod=CtxBlockPl [MEMORY] hold= 4,800 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,704 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,288 used= 3,899 count= 6 avg_used= 649 block_cnt= 5 chunk_cnt= 2 mod=SqlSessiQuerSql [MEMORY] hold= 4,160 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 4,160 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=CsCtxBlockPl [MEMORY] hold= 3,136 used= 3,072 count= 1 avg_used= 3,072 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 3,072 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 3,056 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=PackStateMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=ContextsMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 5 mod=SequenceMap [MEMORY] hold= 2,976 used= 2,544 count= 6 avg_used= 424 block_cnt= 6 chunk_cnt= 4 mod=SequenceIdMap [MEMORY] hold= 2,944 used= 2,624 count= 5 avg_used= 524 block_cnt= 5 chunk_cnt= 3 mod=NotParamIdex [MEMORY] hold= 2,400 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,304 used= 1,792 count= 8 avg_used= 224 block_cnt= 6 chunk_cnt= 4 mod=LogIOTask [MEMORY] hold= 2,240 used= 1,920 count= 5 avg_used= 384 block_cnt= 5 chunk_cnt= 5 mod=TableLockNode [MEMORY] hold= 1,920 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 1,920 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,728 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 1,664 used= 1,600 count= 1 avg_used= 1,600 block_cnt= 1 chunk_cnt= 1 mod=LogPartFetCtxPo [MEMORY] hold= 1,616 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,616 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,600 used= 40 count= 20 avg_used= 2 block_cnt= 20 chunk_cnt= 13 mod=[T]TSIUseWeak [MEMORY] hold= 1,488 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,408 used= 1,280 count= 2 avg_used= 640 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,344 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,264 used= 864 count= 6 avg_used= 144 block_cnt= 6 chunk_cnt= 3 mod=ObTxLSLogCb [MEMORY] hold= 1,152 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,120 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,024 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 848 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=HashBucPsSessIn [MEMORY] hold= 848 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 832 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 720 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 624 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 544 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 480 used= 120 count= 5 avg_used= 24 block_cnt= 1 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 448 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 288 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 288 used= 216 count= 1 avg_used= 216 block_cnt= 1 chunk_cnt= 1 mod=memtable_set [MEMORY] hold= 288 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 272 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 224 used= 64 count= 2 avg_used= 32 block_cnt= 2 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 192 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 192 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 176 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 160 used= 16 count= 2 avg_used= 8 block_cnt= 2 chunk_cnt= 2 mod=ObLogEXTHandler [MEMORY] hold= 128 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 112 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 112 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 112 used= 48 count= 1 avg_used= 48 block_cnt= 1 chunk_cnt= 1 mod=[T]TSITabletTab [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=[T]TSILastOper [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=[T]TSIDDLVar [MEMORY] hold= 80 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 729,295,552 used= 721,731,284 count= 32,388 avg_used= 22,283 mod=SUMMARY [2024-06-24 16:58:49.492628] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=180] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 136,314,880 used= 135,249,920 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 135,249,920 used= 135,188,040 count= 65 avg_used= 2,079,816 block_cnt= 65 chunk_cnt= 65 mod=Memstore [MEMORY] hold= 135,249,920 used= 135,188,040 count= 65 avg_used= 2,079,816 mod=SUMMARY [2024-06-24 16:58:49.492648] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,496 count= 1 avg_used= 722,496 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,496 count= 1 avg_used= 722,496 mod=SUMMARY [2024-06-24 16:58:49.492687] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 140,509,184 used= 136,763,504 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 129,217,136 used= 117,812,699 count= 5,478 avg_used= 21,506 block_cnt= 5,478 chunk_cnt= 67 mod=SqlPhyPlan [MEMORY] hold= 5,543,104 used= 5,300,896 count= 529 avg_used= 10,020 block_cnt= 529 chunk_cnt= 67 mod=SqlPlanCache [MEMORY] hold= 2,001,536 used= 1,938,368 count= 977 avg_used= 1,984 block_cnt= 246 chunk_cnt= 66 mod=CreateContext [MEMORY] hold= 1,728 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 136,763,504 used= 125,053,563 count= 6,986 avg_used= 17,900 mod=SUMMARY [2024-06-24 16:58:49.492711] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,944 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,848 used= 59,018 count= 263 avg_used= 224 block_cnt= 20 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,944 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-06-24 16:58:49.492728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 150,994,944 used= 147,603,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 147,603,456 used= 147,328,896 count= 286 avg_used= 515,136 block_cnt= 286 chunk_cnt= 72 mod=CoStack [MEMORY] hold= 147,603,456 used= 147,328,896 count= 286 avg_used= 515,136 mod=SUMMARY [2024-06-24 16:58:49.492753] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 232,783,872 used= 232,783,872 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 232,783,872 used= 0 count= 111 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 232,783,872 used= 0 count= 111 avg_used= 0 mod=SUMMARY [2024-06-24 16:58:49.492772] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 14,680,064 used= 13,148,160 limit= 3,650,722,200 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,552,448 used= 7,608,556 count= 116 avg_used= 65,591 block_cnt= 116 chunk_cnt= 6 mod=L_TabletPool [MEMORY] hold= 4,194,304 used= 4,186,112 count= 64 avg_used= 65,408 block_cnt= 64 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 13,148,160 used= 12,194,732 count= 182 avg_used= 67,004 mod=SUMMARY [2024-06-24 16:58:49.492789] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 7,344,640 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 7,344,640 used= 7,285,248 count= 918 avg_used= 7,936 block_cnt= 918 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 7,344,640 used= 7,285,248 count= 918 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:49.492808] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 73,536 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 65,536 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=LobAllocator [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 73,536 used= 73,344 count= 2 avg_used= 36,672 mod=SUMMARY [2024-06-24 16:58:49.492824] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 33,600 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,600 used= 31,721 count= 26 avg_used= 1,220 block_cnt= 5 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 33,600 used= 31,721 count= 26 avg_used= 1,220 mod=SUMMARY [2024-06-24 16:58:49.492851] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 6,311,936 used= 5,886,656 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 3,182,528 used= 3,153,728 count= 3 avg_used= 1,051,242 block_cnt= 3 chunk_cnt= 3 mod=MEMTABLE_ARENA [MEMORY] hold= 2,696,128 used= 2,674,432 count= 337 avg_used= 7,936 block_cnt= 337 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 5,886,656 used= 5,836,096 count= 341 avg_used= 17,114 mod=SUMMARY [2024-06-24 16:58:49.492873] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 96,000 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 1 mod=MdsTable [MEMORY] hold= 96,000 used= 95,232 count= 12 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:49.492896] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= SCHEMA_SERVICE hold= 2,097,152 used= 8,000 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenCac [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2024-06-24 16:58:49.492915] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2024-06-24 16:58:49.492937] INFO [LIB] operator() (ob_malloc_allocator.cpp:542) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 2,043,682,816 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 301,744,128 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 8,388,608 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 178,257,920 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 10,485,760 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 12,582,912 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 112,066,560 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 193,744,896 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 1,220,120,576 limit= 9,223,372,036,854,775,807 [2024-06-24 16:58:49.493255] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 301,744,128 used= 256,278,464 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 26,984,448 used= 25,303,776 count= 366 avg_used= 69,136 block_cnt= 366 chunk_cnt= 41 mod=[T]ObSessionDIB [MEMORY] hold= 24,014,848 used= 23,941,952 count= 28 avg_used= 855,069 block_cnt= 28 chunk_cnt= 19 mod=IoControl [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,502,144 used= 10,477,568 count= 64 avg_used= 163,712 block_cnt= 64 chunk_cnt= 23 mod=Iteratorget_logical_del_time()=42103425701222, cache_obj->added_lc()=false, cache_obj->get_object_id()=9373, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:49.615287] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7DAC-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219529614540000, start_id=1719219529614540000, end_id=1719219529614540001) [2024-06-24 16:58:49.615462] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219529614540000, start_id=1719219529614540000, end_id=1719219529614540001) [2024-06-24 16:58:49.617029] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0424D7-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:49.619069] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD11C-0-0] [lt=8] get number(ret=0, service_type_=0, range=1, base_id=1719219529618743000, start_id=1719219529618743000, end_id=1719219529618743001) [2024-06-24 16:58:49.619803] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E65-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.621648] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=17] gc stale ls task succ [2024-06-24 16:58:49.621658] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=15] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:49.622434] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E6A-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219529621869000, start_id=1719219529621869000, end_id=1719219529621869001) [2024-06-24 16:58:49.624087] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7DBB-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.626560] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:49.626672] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:49.626847] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:49.626905] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:49.627049] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:49.627116] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:49.627207] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E70-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:49.633259] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075E76-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:49.644667] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=33] success to update min reserved snapshot(reserved_snapshot=1719217726812609000, duration=1800, snapshot_gc_ts=1719219526812609000) [2024-06-24 16:58:49.645239] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217726812609000) [2024-06-24 16:58:49.645263] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=21] update reserved snapshot finished(cost_ts=612, reserved_snapshot=1719217726812609000) [2024-06-24 16:58:49.646019] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=371, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:49.646058] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=18, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:49.657289] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1719219529657277, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-06-24 16:58:49.658883] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13756, offset=3455358}, end_cursor:ObLogCursor{file_id=1, log_id=13757, offset=3455631}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d2c050, len:1666, log_data_len:273, seq:13756, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:49.661534] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.662022] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D918-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219529662007000, start_id=1719219529662007000, end_id=1719219529662007001) [2024-06-24 16:58:49.662105] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D918-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8258, avg_group_log_size=516) [2024-06-24 16:58:49.662131] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D918-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8259) [2024-06-24 16:58:49.662469] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8258) [2024-06-24 16:58:49.662521] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8258) [2024-06-24 16:58:49.662557] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=454, avg_log_submit_to_slide_time=462) [2024-06-24 16:58:49.663129] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13757, offset=3455631}, end_cursor:ObLogCursor{file_id=1, log_id=13758, offset=3455896}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d30050, len:1393, log_data_len:265, seq:13757, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:49.666669] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7DFB-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.668552] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219529668340000, start_id=1719219529668340000, end_id=1719219529668340001) [2024-06-24 16:58:49.669134] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7DFD-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4804, pos=2778, bitmap=NULL) [2024-06-24 16:58:49.673838] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:49.673841] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=431, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:49.673869] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:49.673902] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:49.673929] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=510, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:49.673945] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=24, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:49.680844] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=408, avg_log_submit_to_slide_time=418) [2024-06-24 16:58:49.685878] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.688651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283387719680, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:49.700656] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=16] gc stale ls task succ [2024-06-24 16:58:49.702142] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=67] LogLoopThread round_cost_time(us)(round_cost_time=17) [2024-06-24 16:58:49.713999] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075EDD-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.716891] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:49.716948] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=37] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1241) [2024-06-24 16:58:49.723271] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:49.723295] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:49.723324] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=103080112, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:49.729490] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:49.729819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219529729388000, start_id=1719219529729388000, end_id=1719219529729388001) [2024-06-24 16:58:49.729898] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3525, avg_group_log_size=352) [2024-06-24 16:58:49.729923] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3525) [2024-06-24 16:58:49.731065] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=22] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:49.731164] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [1204][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=88] BlockGCTimerTask success(ret=0, cost_time_us=15, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1004", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):44236, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):44236, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):226, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:49.749545] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=18] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:49.756607] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219529755750000, start_id=1719219529755750000, end_id=1719219529755750001) [2024-06-24 16:58:49.761592] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.763405] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=36952, mem_used=147661824) [2024-06-24 16:58:49.770889] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=15] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:49.770932] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=30] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:49.770953] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=18] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:49.770968] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=13] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1220) [2024-06-24 16:58:49.773926] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:49.773940] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:49.773976] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=429, avg_log_submit_to_slide_time=440) [2024-06-24 16:58:49.778395] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [163826][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=24] report RowHolderMapper summary info(count=2620, bkt_cnt=7851) [2024-06-24 16:58:49.780034] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD124-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780208] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075F30-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780316] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04255A-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780541] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A30B-0-0] [lt=12][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780546] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0020-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780559] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=9520, avg_group_log_size=528) [2024-06-24 16:58:49.780591] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=10272) [2024-06-24 16:58:49.780762] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE788-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780831] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152C2-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.780950] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9520) [2024-06-24 16:58:49.780997] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=9520) [2024-06-24 16:58:49.781018] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=17, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=405, avg_log_submit_to_slide_time=413) [2024-06-24 16:58:49.781208] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820C0-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.781905] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C93E5-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.782930] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494482, support_ssl=false) [2024-06-24 16:58:49.783007] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=35] sm conn init succ(conn.sessid_=3221494482, sess.client_addr_="172.20.17.86:49534") [2024-06-24 16:58:49.783031] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f47833c2030, session_id:3221494482, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:49.783113] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494482, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:49.783151] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=32] kill and revert session(conn.sessid_=3221494482, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:49.783167] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494482, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:49.783191] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494482) [2024-06-24 16:58:49.783205] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162501][sql_nio11][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494482, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:49.785292] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0028-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.785354] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE78B-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.785829] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0029-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.785846] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EA8-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.785938] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.788594] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A312-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.790694] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EAF-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.791195] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C93F1-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.792495] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0030-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.793425] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EB6-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.793693] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C93F5-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.793843] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE792-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.793971] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219529793743000, start_id=1719219529793743000, end_id=1719219529793743001) [2024-06-24 16:58:49.794050] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:49.794085] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:49.794494] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=374, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:49.794532] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=16, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:49.794564] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:49.794591] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=440, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:49.794608] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=24, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:49.796485] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE794-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.797099] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0035-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.797937] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042568-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.798498] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C93F9-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.798750] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EC1-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.799568] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A2A-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.799956] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A320-0-0] [lt=42][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.800112] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EC4-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.801138] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257424-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.801657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:49.801679] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EC8-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219529801143000, start_id=1719219529801143000, end_id=1719219529801143001) [2024-06-24 16:58:49.801686] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152C5-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.802676] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [703][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CB94D40-0-0] [lt=33][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.802971] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD132-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.803266] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [703][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CB94D41-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.804081] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257426-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.804436] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A322-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.805774] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE79F-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.808502] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A323-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.809091] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD136-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.809846] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7ED4-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.810668] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0041-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.810782] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A324-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.810967] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075F65-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.811143] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042576-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.814479] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EDB-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.814552] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE7A7-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.814747] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152CB-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.814978] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820D1-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.815484] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EDD-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.815596] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219529814873000, start_id=1719219529814873000, end_id=1719219529814873001) [2024-06-24 16:58:49.816085] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EDE-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.816581] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A328-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.817402] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE7A8-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.817564] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075F70-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.819038] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD141-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.819187] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152D0-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.820792] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A004A-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.821081] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152D2-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.821093] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075F78-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.821232] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042583-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.821252] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD144-0-0] [lt=34][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.822367] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152D3-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.822447] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EED-0-0] [lt=17][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.822968] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EEE-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.823224] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A004C-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.823385] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EEF-0-0] [lt=17][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.824509] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A41-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.824821] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075F7E-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.824854] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A004F-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.824860] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257434-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.825072] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152D7-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.825083] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7EF4-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.825092] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE7B5-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.825314] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820E4-0-0] [lt=28] submit log success(service_type_=0, last_id=1719219546480480000, limited_id=1719219546480480000) [2024-06-24 16:58:49.825341] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820E4-0-0] [lt=26] submit log with lock success(service_type_=0, last_id=1719219546480480000, limited_id=1719219546480480000) [2024-06-24 16:58:49.825361] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820E4-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219529824381000, start_id=1719219529824381000, end_id=1719219529824381001) [2024-06-24 16:58:49.825806] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A7EC8-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1719219546480480000, latest_scn={val:1719219529824381001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219527359914001, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:49.825887] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257436-0-0] [lt=23][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.825896] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A7EC8-0-0] [lt=88] handle submit callback(service_type_=0, success=true, used_ts=584, log_ts={val:1719219529824381001, v:0}, limited_id=1719219546480480000) [2024-06-24 16:58:49.825919] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A7EC8-0-0] [lt=22] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:49.825938] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA13A7EC8-0-0] [lt=17] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:49.827143] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820E6-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.827266] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=30, mem_used=49913856) [2024-06-24 16:58:49.827300] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=23] release old cannot free more memory [2024-06-24 16:58:49.827314] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=12] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=48, size_used=0, mem_used=49913856) [2024-06-24 16:58:49.827524] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9423-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.827556] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD14F-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.827909] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [713][T1002_L0_G0][T1002][YB42AC141156-00061B9D92E11E2E-0-0] [lt=32][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.828137] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152DE-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.829275] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075F8A-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.829511] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0054-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.829669] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F04-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.829919] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [703][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CB94D47-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.830076] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152E3-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.830192] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820E7-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.831217] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C942C-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.831558] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD154-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.831866] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820EA-0-0] [lt=25][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.831988] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F0C-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.832199] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC12A24-0-0] [lt=33][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.833177] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA125743D-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.833359] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042598-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.833739] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9431-0-0] [lt=34][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.834996] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F16-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.835297] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE7BE-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.835720] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257442-0-0] [lt=28][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.836127] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F18-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.836315] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [693][T1002_L0_G0][T1002][YB42AC141156-00061B9D9CC12A25-0-0] [lt=31][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.836600] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A33D-0-0] [lt=36][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.837713] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F1B-0-0] [lt=21][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.837710] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A33E-0-0] [lt=43][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.837749] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE7C0-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.837841] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C9438-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.838660] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0063-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.838726] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E820F1-0-0] [lt=30][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.838742] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A33F-0-0] [lt=20][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.839046] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [733][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1257448-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.839082] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C943A-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.839508] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [738][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0CCE7C1-0-0] [lt=33][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.840574] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F22-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.841263] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F23-0-0] [lt=22][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.841551] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0425A5-0-0] [lt=33][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.843409] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F29-0-0] [lt=16][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.843574] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD161-0-0] [lt=24][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.843898] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A343-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.845330] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0425AC-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.845447] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F2F-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.846386] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD163-0-0] [lt=29][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.846694] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F33-0-0] [lt=19][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.861638] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.862204] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1075FC7-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:49.865220] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219529864473000, start_id=1719219529864473000, end_id=1719219529864473001) [2024-06-24 16:58:49.865261] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=36] handle gts request statistics(total_rt=872, total_cnt=101, avg_rt=8.549019607843137081e+00, avg_cnt=1.009999999999999964e+01) [2024-06-24 16:58:49.868604] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219529867642000, start_id=1719219529867642000, end_id=1719219529867642001) [2024-06-24 16:58:49.869201] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] get_max_applied_scn(scn={val:1719219529625043000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:517744699}, palf_committed_end_scn_:{val:1719219529824381000, v:0}, last_check_scn_:{val:1719219529824381000, v:0}, max_applied_cb_scn_:{val:1719219529625043000, v:0}}) [2024-06-24 16:58:49.873712] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F63-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:49.873991] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874209] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874252] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874424] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874424] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874493] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874610] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874616] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874696] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874706] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874711] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874715] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874721] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874727] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874736] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874747] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874768] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874770] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874788] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874791] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874786] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874821] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874831] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.874957] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:49.876049] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F65-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:49.881362] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0425CD-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:49.883669] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F73-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:49.885906] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7F75-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:49.886000] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.889191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283387719680, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:49.907515] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076000-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:49.910292] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076002-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:49.912200] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:49.913782] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA6-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.915836] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:49.915925] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:49.916081] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:49.916134] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:49.916260] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:49.916326] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:49.916405] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FA9-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:49.922220] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FB6-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:49.929947] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219529929914000, start_id=1719219529929914000, end_id=1719219529929914001) [2024-06-24 16:58:49.954853] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0425FD-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:49.956747] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1719219529956290000, start_id=1719219529956290000, end_id=1719219529956290001) [2024-06-24 16:58:49.957125] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A7FEE-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:49.961696] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.973692] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:49.973734] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:49.973763] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:49.973786] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:49.973827] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:49.974410] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=405, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:49.986057] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:49.993993] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219529993196000, start_id=1719219529993196000, end_id=1719219529993196001) [2024-06-24 16:58:50.000949] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8033-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.001768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:50.003516] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:50.011648] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:50.011699] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=37] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1241) [2024-06-24 16:58:50.016104] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219530015373000, start_id=1719219530015373000, end_id=1719219530015373001) [2024-06-24 16:58:50.018277] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=34] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12255, add_timestamp:1719219530018259}) [2024-06-24 16:58:50.018320] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06C-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12255, locations=[{table_id:12255, partition_id:12255, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530018295, sql_renew_time:1719219530018295, is_mark_fail:false}]) [2024-06-24 16:58:50.018348] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06C-0-0] [lt=27] success to process renew task(task={tenant_id:1, table_id:12255, add_timestamp:1719219530018259}, locations=[{table_id:12255, partition_id:12255, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530018295, sql_renew_time:1719219530018295, is_mark_fail:false}]) [2024-06-24 16:58:50.019893] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=15] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16509, offset=3762103}, end_cursor:ObLogCursor{file_id=1, log_id=16510, offset=3762376}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d34050, len:2121, log_data_len:273, seq:16509, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:50.023943] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D909-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219530023826000, start_id=1719219530023826000, end_id=1719219530023826001) [2024-06-24 16:58:50.024038] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D909-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8888, avg_group_log_size=683) [2024-06-24 16:58:50.024067] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D909-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8352) [2024-06-24 16:58:50.024420] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8888) [2024-06-24 16:58:50.024475] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8888) [2024-06-24 16:58:50.024514] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=414, avg_log_submit_to_slide_time=424) [2024-06-24 16:58:50.025105] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=33] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16510, offset=3762376}, end_cursor:ObLogCursor{file_id=1, log_id=16511, offset=3762641}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d3c050, len:1848, log_data_len:265, seq:16510, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:50.025907] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=31] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1}) [2024-06-24 16:58:50.025941] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=33] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"sys", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.025963] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=21] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"TIMESTAMP":"2024-06-24 07:14:57.665120"}) [2024-06-24 16:58:50.025983] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=20] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.025998] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=15] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.026012] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.026025] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"NORMAL", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.026039] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.026049] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=10] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.026062] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"DISABLED", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.027647] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1719219530027639, bytes: 171002008, bw: 0.019077 MB/s, add_ts: 1007631, add_bytes: 20156 [2024-06-24 16:58:50.028121] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1}) [2024-06-24 16:58:50.028192] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=30] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1002}) [2024-06-24 16:58:50.028220] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=18] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1004}) [2024-06-24 16:58:50.028338] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=15] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1001}) [2024-06-24 16:58:50.028357] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=19] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"META$1002", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028374] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=17] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"TIMESTAMP":"2024-06-24 07:15:24.118736"}) [2024-06-24 16:58:50.028389] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=15] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028404] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=15] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028418] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028431] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"NORMAL", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028446] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028458] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028468] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=10] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"DISABLED", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028497] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=10] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1002}) [2024-06-24 16:58:50.028513] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=16] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"ocp_meta", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028527] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"TIMESTAMP":"2024-06-24 07:15:24.127165"}) [2024-06-24 16:58:50.028541] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028555] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028569] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028582] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"NORMAL", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028596] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028612] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=16] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028640] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=27] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"DISABLED", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028691] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=10] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1003}) [2024-06-24 16:58:50.028707] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=15] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"META$1004", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028723] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=16] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"TIMESTAMP":"2024-06-24 07:15:50.821601"}) [2024-06-24 16:58:50.028734] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=10] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028746] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=11] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028760] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028773] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"NORMAL", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028787] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028800] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028813] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"DISABLED", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028835] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":1004}) [2024-06-24 16:58:50.028849] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=13] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"ocp_monitor", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028863] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"TIMESTAMP":"2024-06-24 07:15:50.822659"}) [2024-06-24 16:58:50.028879] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=16] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"RANDOM", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028894] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"FULL{1}@zone1", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028908] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=14] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028921] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"NORMAL", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.028932] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=11] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028945] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"BIGINT":0}) [2024-06-24 16:58:50.028958] INFO [SERVER] inner_get_next_row (ob_agent_virtual_table.cpp:270) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC1E-0-0] [lt=12] mysql compat mode agent do not do convert(ret=0, ret="OB_SUCCESS", input={"VARCHAR":"DISABLED", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}) [2024-06-24 16:58:50.031720] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [1462][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=85] BlockGCTimerTask success(ret=0, cost_time_us=9, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1003", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):4915, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):4915, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):134, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:50.036652] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB62-0-0] [lt=25] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12095, add_timestamp:1719219530036608}) [2024-06-24 16:58:50.036665] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06D-0-0] [lt=14] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12095, locations=[{table_id:12095, partition_id:12095, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530036656, sql_renew_time:1719219530036656, is_mark_fail:false}]) [2024-06-24 16:58:50.036677] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06D-0-0] [lt=11] success to process renew task(task={tenant_id:1, table_id:12095, add_timestamp:1719219530036608}, locations=[{table_id:12095, partition_id:12095, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530036656, sql_renew_time:1719219530036656, is_mark_fail:false}]) [2024-06-24 16:58:50.036703] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB62-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12450, add_timestamp:1719219530036696}) [2024-06-24 16:58:50.036713] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06E-0-0] [lt=9] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12450, locations=[{table_id:12450, partition_id:12450, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530036709, sql_renew_time:1719219530036709, is_mark_fail:false}]) [2024-06-24 16:58:50.036723] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06E-0-0] [lt=10] success to process renew task(task={tenant_id:1, table_id:12450, add_timestamp:1719219530036696}, locations=[{table_id:12450, partition_id:12450, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530036709, sql_renew_time:1719219530036709, is_mark_fail:false}]) [2024-06-24 16:58:50.046331] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=418, avg_log_submit_to_slide_time=431) [2024-06-24 16:58:50.056021] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:50.060161] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 406.00) [2024-06-24 16:58:50.060188] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:50.060283] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 394.50) [2024-06-24 16:58:50.060299] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:50.060332] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060354] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060371] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060386] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060397] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060411] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060424] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060438] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060452] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060465] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060482] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060496] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060510] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060523] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060537] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.060551] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:50.061760] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.068682] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219530068221000, start_id=1719219530068221000, end_id=1719219530068221001) [2024-06-24 16:58:50.073727] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] tx gc loop thread is running(MTL_ID()=1004) [2024-06-24 16:58:50.073754] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] try gc retain ctx [2024-06-24 16:58:50.073785] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=11] get_max_applied_scn(scn={val:1719219529865529001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:45091138}, palf_committed_end_scn_:{val:1719219529865529001, v:0}, last_check_scn_:{val:1719219529865529001, v:0}, max_applied_cb_scn_:{val:1719219529865529001, v:0}}) [2024-06-24 16:58:50.073823] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=34] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:50.076326] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=104] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219527861214001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:50.076822] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=38] LogLoopThread round_cost_time(us)(round_cost_time=17) [2024-06-24 16:58:50.076927] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1333) [2024-06-24 16:58:50.076965] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=460, avg_log_submit_to_slide_time=470) [2024-06-24 16:58:50.077830] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB63-0-0] [lt=17][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103426169194, cache_obj->added_lc()=false, cache_obj->get_object_id()=9374, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:50.078727] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=117] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219527861214001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:50.079168] WDIAG get_refactored (ob_hashtable.h:1102) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC23-0-0] [lt=14][errcode=-4201] hashtable not init [2024-06-24 16:58:50.079193] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC23-0-0] [lt=24][errcode=-4016] get cursor info failed(cursor_id=1153, get_sessid()=3221489125) [2024-06-24 16:58:50.079323] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219530078806000, start_id=1719219530078806000, end_id=1719219530078806001) [2024-06-24 16:58:50.086115] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.089754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283375116288, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:50.096435] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096439] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096496] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096654] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096657] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096663] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096923] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.096951] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097001] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097165] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097561] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097563] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097602] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097601] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1136, mem_used=4159488) [2024-06-24 16:58:50.097620] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097652] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097675] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=7] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097677] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097714] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097675] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097690] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097710] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097718] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097718] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097674] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097730] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097766] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097765] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097804] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097940] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097982] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.097993] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098065] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098143] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098226] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098228] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098239] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098260] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098374] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098711] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098715] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098743] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098761] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098749] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098764] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098757] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098758] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098766] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098771] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098772] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098781] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098821] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.098830] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.099223] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.109662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC25-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=46, pos=9, bitmap=NULL) [2024-06-24 16:58:50.112393] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:50.112417] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:50.112450] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=73638735, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:50.115776] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD24-0-0] [lt=32] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:50.115809] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD24-0-0] [lt=24] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=34) [2024-06-24 16:58:50.118009] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=33] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:50.118051] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=30] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:50.118072] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=18] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:50.118086] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=13] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1233) [2024-06-24 16:58:50.122773] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=12] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:67617, max_lsn:53512118, max_scn:{val:1719219530078806000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:53512118}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:11569078}}, last_submit_lsn:{lsn:53511559}, last_submit_end_lsn:{lsn:53512118}, last_submit_log_id:67617, last_submit_log_pid:1, max_flushed_lsn:{lsn:53511559}, max_flushed_end_lsn:{lsn:53512118}, max_flushed_log_pid:1, committed_end_lsn:{lsn:53512118}, last_slide_log_id:67617, last_slide_scn:{val:1719219530078806000, v:0}, last_slide_lsn:{lsn:53511559}, last_slide_end_lsn:{lsn:53512118}, last_slide_log_pid:1, last_slide_log_accum_checksum:382344359, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f47b6888530}, [StateMgr]={this:0x7f47b688c2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:67618, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213258395201, palf_role_change_cb:0x7f47b6892cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f47b6889c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1/1/meta", dir_fd:657, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f47b688e478, flashback_version:0}, log_storage:{log_tail:{lsn:53512118}, readable_log_tail:{lsn:53512118}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1/1/log", dir_fd:658, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:13592650, block_header_serialize_buf_:0x7f47b6890138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213258395305, this:0x7f47b688c9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213258395809, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f47b688c430}) [2024-06-24 16:58:50.123155] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=377] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219530079835, last_flushed_end_lsn:{lsn:53512118}}]) [2024-06-24 16:58:50.123183] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=67618, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219530079835, last_flushed_end_lsn:{lsn:53512118}}]) [2024-06-24 16:58:50.129888] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [162968][T1_TenantWeakRe][T1][YB42AC141156-00061B9D89B1398E-0-0] [lt=30] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=200) [2024-06-24 16:58:50.130153] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219530129460000, start_id=1719219530129460000, end_id=1719219530129460001) [2024-06-24 16:58:50.135132] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=15] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:50.139533] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076114-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:50.140165] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC27-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=46, pos=9, bitmap=NULL) [2024-06-24 16:58:50.142366] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076115-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:50.147153] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107611C-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:50.149660] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A811D-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4806, pos=2778, bitmap=NULL) [2024-06-24 16:58:50.150762] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=17] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:50.152134] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A811E-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:50.156667] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138AA-0-0] [lt=31] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336819486618041992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.884401192498512501e+01) [2024-06-24 16:58:50.156919] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=53] get number(ret=0, service_type_=0, range=1, base_id=1719219530156858000, start_id=1719219530156858000, end_id=1719219530156858001) [2024-06-24 16:58:50.161815] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.166000] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06F-0-0] [lt=8] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:50.166305] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06F-0-0] [lt=11] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530166289, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:50.166329] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D06F-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1719219530165971}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219530166289, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:50.168863] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB6A-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=46, pos=9, bitmap=NULL) [2024-06-24 16:58:50.172592] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E6-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:50.172637] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E6-0-0] [lt=41] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:50.173766] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D901-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:50.173801] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D901-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:50.173859] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=92] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1211) [2024-06-24 16:58:50.174317] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:50.174342] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:50.174369] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=466, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:50.174387] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:50.175006] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0426A6-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:50.176281] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=25] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:50.176730] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107613A-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.179437] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107613E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:50.182136] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:50.182224] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:50.182425] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:50.182479] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:50.182605] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:50.182674] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:50.182754] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A815F-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:50.186173] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.188915] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107614D-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:50.194182] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219530193858000, start_id=1719219530193858000, end_id=1719219530193858001) [2024-06-24 16:58:50.197802] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [163138][T1_L0_G0][T1][YB42AC141156-00061B9D8E00C115-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=46, pos=9, bitmap=NULL) [2024-06-24 16:58:50.201863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:50.202202] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:50.214562] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107617A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:50.215894] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107617B-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:50.216231] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219530216055000, start_id=1719219530216055000, end_id=1719219530216055001) [2024-06-24 16:58:50.232598] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [803][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=47] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:50.235685] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [939][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=26] report RowHolderMapper summary info(count=2620, bkt_cnt=7836) [2024-06-24 16:58:50.244517] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=11] ====== checkpoint timer task ====== [2024-06-24 16:58:50.244558] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=19] get_max_applied_scn(scn={val:1719219530156858000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:73639913}, palf_committed_end_scn_:{val:1719219530193858000, v:0}, last_check_scn_:{val:1719219530193858000, v:0}, max_applied_cb_scn_:{val:1719219530156858000, v:0}}) [2024-06-24 16:58:50.244592] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:50.246021] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:50.246064] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:50.246492] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:50.246521] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=446, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:50.246540] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=29, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:50.246825] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=125] succ to get rec scn(*this={this:0x7f46f0604030, ls_id:{id:1}, tenant_id:1003, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216321111181000, v:0}, last_push_gc_task_ts_:1719216953731290, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:50.246861] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=35] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46f1df0080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216953736744, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46f1df0080, snapshot_version:{val:1719216953736744, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:50.246904] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=36] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:50.247047] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=26] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:50.247164] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=111] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46f1d8d790}, min_rec_scn={val:1719216953754927000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:50.247192] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:50.247215] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219527861214001, v:0}) [2024-06-24 16:58:50.247229] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:50.247243] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:50.247263] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216953754927000, v:0}, checkpoint_scn_in_ls_meta={val:1719216953754927000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:50.247299] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:50.247324] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:50.247341] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:50.252276] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A81CF-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.253482] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=14] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:50.253521] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=28] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:50.253542] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1240) [2024-06-24 16:58:50.261871] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.265785] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB7B-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=46, pos=9, bitmap=NULL) [2024-06-24 16:58:50.268769] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219530267797000, start_id=1719219530267797000, end_id=1719219530267797001) [2024-06-24 16:58:50.281138] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=110] tx gc loop thread is running(MTL_ID()=1003) [2024-06-24 16:58:50.281162] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=23] try gc retain ctx [2024-06-24 16:58:50.281282] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1348) [2024-06-24 16:58:50.283159] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:50.283190] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=30] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:50.283191] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72A-0-0] [lt=22] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:50.283237] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72A-0-0] [lt=36] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:50.283485] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=10] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1003, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:50.286232] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.290283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283377233920, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:50.292758] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC3A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=1, len=46, pos=9, bitmap=NULL) [2024-06-24 16:58:50.306765] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [348][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:50.306969] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BD-0-0] [lt=34] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219527359914001, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:50.307169] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BD-0-0] [lt=126] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219527359914001, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:50.307272] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BD-0-0] [lt=99] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:50.327374] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112417, mem_used=264127488) [2024-06-24 16:58:50.330157] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219530330041000, start_id=1719219530330041000, end_id=1719219530330041001) [2024-06-24 16:58:50.332230] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:397) [162151][ServerTracerTim][T0][YB42AC141156-00061B9D86E0C5CD-0-0] [lt=27] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-06-24 16:58:50.344190] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:50.356921] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219530356383000, start_id=1719219530356383000, end_id=1719219530356383001) [2024-06-24 16:58:50.357549] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [WRS] update tenant weak read server version(tenant_id=1003, server_version={version:{val:1719219530193858000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1719219530357518}, version_delta=163690) [2024-06-24 16:58:50.357711] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=66] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2024-06-24 16:58:50.359603] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=32] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1004) [2024-06-24 16:58:50.359641] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1001) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=35] no transfer partition job [2024-06-24 16:58:50.359659] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1031) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=13] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer={value_str:"True"}) [2024-06-24 16:58:50.361931] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.363294] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=21] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1004, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2024-06-24 16:58:50.363347] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:482) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=38] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2024-06-24 16:58:50.366130] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219530365899000, start_id=1719219530365899000, end_id=1719219530365899001) [2024-06-24 16:58:50.366179] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:50.366659] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219530366616], gts:1719219530365899000, latest_srr:[mts=1719219530366616]}) [2024-06-24 16:58:50.366923] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2024-06-24 16:58:50.367017] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [1222][T1004_TBalance][T1004][YB42AC141156-00061B9D9930C34C-0-0] [lt=29] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1004, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1002, status:0}], ls_array_=[{tenant_id:1004, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1002, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1719213373528854, last_statistic_bg_stat_time=1719216987199453, last_statistic_schema_version=1719216919372024, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2024-06-24 16:58:50.373984] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:50.374017] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:50.376450] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [960][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=14] ====== traversal_flush timer task ====== [2024-06-24 16:58:50.376612] INFO [MDS] flush (mds_table_mgr.cpp:172) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BD-0-0] [lt=26] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219537830421000, latest_log_ts:{val:1719219521210793001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:50.376733] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BD-0-0] [lt=115] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:50.379123] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A829F-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:50.380903] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:50.380943] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:50.380973] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:50.380996] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:50.381320] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=395, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:50.381320] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=390, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:50.381353] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:50.381355] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:50.381384] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:50.381414] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=447, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:50.381438] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=19, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:50.381467] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:50.381482] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=474, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:50.381493] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=16, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:50.381593] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82A2-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:50.385401] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10762CD-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:50.386291] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.386943] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10762CE-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:50.388498] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10762CF-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:50.394291] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219530393368000, start_id=1719219530393368000, end_id=1719219530393368001) [2024-06-24 16:58:50.401955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:50.407788] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82CC-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:50.409185] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B2-0-0] [lt=44][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:50.409215] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B2-0-0] [lt=29][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:50.410254] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82CF-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.416321] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219530415493000, start_id=1719219530415493000, end_id=1719219530415493001) [2024-06-24 16:58:50.416964] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:50.419202] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82D5-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:50.421922] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129872, mem_used=326519808) [2024-06-24 16:58:50.422082] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:50.422174] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:50.422331] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:50.422384] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:50.422511] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:50.422570] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:50.422657] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A82DD-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:50.433134] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2024-06-24 16:58:50.433504] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107631F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:50.434416] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [162311][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=32] runTimer to refresh locality_info(ret=0) [2024-06-24 16:58:50.435231] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219530434517000, start_id=1719219530434517000, end_id=1719219530434517001) [2024-06-24 16:58:50.436647] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=24] set_server_locality_array success(server_locality_array=[{inited:true, addr:"172.20.17.86:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1719213306412144, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2024-06-24 16:58:50.436705] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=47] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2024-06-24 16:58:50.436727] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=21] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2024-06-24 16:58:50.436748] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2024-06-24 16:58:50.436757] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=9] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2024-06-24 16:58:50.436776] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=14] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2024-06-24 16:58:50.436788] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2024-06-24 16:58:50.436802] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1003, primary_zone=RANDOM) [2024-06-24 16:58:50.436806] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1003) [2024-06-24 16:58:50.436814] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=11] add_locality_zone success(locality_zone={tenant_id:1003, region_priority:18446744073709551615}) [2024-06-24 16:58:50.436824] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=9] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1004, primary_zone=RANDOM) [2024-06-24 16:58:50.436836] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] add_locality_zone success(locality_zone={tenant_id:1004, region_priority:18446744073709551615}) [2024-06-24 16:58:50.436855] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [162310][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}, {tenant_id:1003, region_priority:18446744073709551615}, {tenant_id:1004, region_priority:18446744073709551615}]}) [2024-06-24 16:58:50.438761] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219530438748000, start_id=1719219530438748000, end_id=1719219530438748001) [2024-06-24 16:58:50.461991] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.467718] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2024-06-24 16:58:50.467904] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8324-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:50.468999] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219530468315000, start_id=1719219530468315000, end_id=1719219530468315001) [2024-06-24 16:58:50.469068] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:50.469098] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:50.469440] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=353, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:50.469475] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:50.469513] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=7, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:50.469530] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=28] run rewrite rule refresh task(rule_mgr_->tenant_id_=1004) [2024-06-24 16:58:50.469538] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=413, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:50.469556] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=25, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:50.471156] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8326-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:50.471534] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219530471487000, start_id=1719219530471487000, end_id=1719219530471487001) [2024-06-24 16:58:50.481384] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1226) [2024-06-24 16:58:50.482197] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:50.483430] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1364][T1004_LCLSender][T1004][Y0-0000000000000000-0-0] [lt=48] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47231fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:50.486348] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.490784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283379331072, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:50.491437] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:520) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] [CACHE] tenant_id= 1 cache memory info: [CACHE] tenant_id= 1 | cache_name= schema_cache | cache_size= 193510400 | cache_store_size= 191430656 | cache_map_size= 2079744 | kv_cnt= 7883 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= vtable_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 56 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 43 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= user_block_cache | cache_size= 8322048 | cache_store_size= 6242304 | cache_map_size= 2079744 | kv_cnt= 146 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= user_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 9 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= fuse_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 32 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= storage_meta_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 164 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 159 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 24 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2024-06-24 16:58:50.491594] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:520) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] [CACHE] tenant_id= 1001 cache memory info: [CACHE] tenant_id= 1001 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 21 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 57 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= fuse_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 21 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= storage_meta_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 90 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 44 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2024-06-24 16:58:50.491782] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:520) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] [CACHE] tenant_id= 1002 cache memory info: [CACHE] tenant_id= 1002 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 473 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= user_block_cache | cache_size= 16645120 | cache_store_size= 14565376 | cache_map_size= 2079744 | kv_cnt= 396 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= user_row_cache | cache_size= 8322048 | cache_store_size= 6242304 | cache_map_size= 2079744 | kv_cnt= 1129 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= bf_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= fuse_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 913 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= storage_meta_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 82 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 181 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 150 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2024-06-24 16:58:50.491926] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:520) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] [CACHE] tenant_id= 1003 cache memory info: [CACHE] tenant_id= 1003 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 41 | hold_size= 0 [CACHE] tenant_id= 1003 | cache_name= user_block_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 230 | hold_size= 0 [CACHE] tenant_id= 1003 | cache_name= bf_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1003 | cache_name= fuse_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 29 | hold_size= 0 [CACHE] tenant_id= 1003 | cache_name= storage_meta_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1003 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 37 | hold_size= 0 [CACHE] tenant_id= 1003 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2024-06-24 16:58:50.492065] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:520) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] [CACHE] tenant_id= 1004 cache memory info: [CACHE] tenant_id= 1004 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 40 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= user_block_cache | cache_size= 12483584 | cache_store_size= 10403840 | cache_map_size= 2079744 | kv_cnt= 286 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= user_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1240 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= bf_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= fuse_row_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 26 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= storage_meta_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 108 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 98 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 32 | hold_size= 0 [CACHE] tenant_id= 1004 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2024-06-24 16:58:50.492119] INFO print_current_status (ob_kvcache_hazard_version.cpp:328) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] [KVCACHE-HAZARD] hazard version status info: current_version: 11318 | min_version= 11318 | total_nodes_count: 6 | [KVCACHE-HAZARD] i= 158 | acquire_version=18446744073709551615 | waiting_nodes_count= 4 | last_retire_version= 11312 | [KVCACHE-HAZARD] i= 705 | acquire_version=18446744073709551615 | waiting_nodes_count= 2 | last_retire_version= 0 | [2024-06-24 16:58:50.499989] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2024-06-24 16:58:50.502029] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219530501049000, start_id=1719219530501049000, end_id=1719219530501049001) [2024-06-24 16:58:50.502555] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A7C36-0-0] [lt=13] [APPLY STAT CB APPEND COST TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=46, this=0x7f4753d24280, extra_info="") [2024-06-24 16:58:50.502580] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A7C36-0-0] [lt=23] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=433, this=0x7f4753d244b0, extra_info="") [2024-06-24 16:58:50.502596] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A7C36-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=0, this=0x7f4753d246e0, extra_info="") [2024-06-24 16:58:50.502610] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A7C36-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-460, this=0x7f4753d24910, extra_info="") [2024-06-24 16:58:50.502652] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13A7C36-0-0] [lt=41] [APPLY STAT CB TOTAL TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=18, this=0x7f4753d24b40, extra_info="") [2024-06-24 16:58:50.503819] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [162977][T1_ArcSender][T1][YB42AC141156-00061B9D8760C0E5-0-0] [lt=22][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:50.515823] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8372-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.528472] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1719219530330041000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198425, in_cluster_service=true, cluster_version={val:1719219530129460000, v:0}, min_cluster_version={val:1719219530129460000, v:0}, max_cluster_version={val:1719219530129460000, v:0}, get_cluster_version_err=0, cluster_version_delta=399006, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60616, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219313404268000, v:0}, local_cluster_delta=217124198, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:50.530310] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1719219530529584000, start_id=1719219530529584000, end_id=1719219530529584001) [2024-06-24 16:58:50.530769] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4083) [2024-06-24 16:58:50.530827] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4083) [2024-06-24 16:58:50.531004] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219530330041000, v:0}, new_max_version={val:1719219530330041000, v:0}, last_min_version={val:1719219530129460000, v:0}, last_max_version={val:1719219530129460000, v:0}, total_time_us=2466, delta_us=200961) [2024-06-24 16:58:50.531037] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219530330041000, v:0}, min_version={val:1719219530330041000, v:0}, max_version={val:1719219530330041000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:50.540653] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=24] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:50.552006] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=55] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:50.557034] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219530556986000, start_id=1719219530556986000, end_id=1719219530556986001) [2024-06-24 16:58:50.562051] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.564363] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-06-24 16:58:50.566313] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219530565439000, start_id=1719219530565439000, end_id=1719219530565439001) [2024-06-24 16:58:50.566532] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=30] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:50.568296] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:50.568398] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526709080000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:50.580409] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076446-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219530580201000, start_id=1719219530580201000, end_id=1719219530580201001) [2024-06-24 16:58:50.586145] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD188-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:50.586406] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.586505] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD188-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:50.586800] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD188-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:50.587093] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD188-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:50.587572] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD188-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:50.594407] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219530593943000, start_id=1719219530593943000, end_id=1719219530593943001) [2024-06-24 16:58:50.599643] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=10] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1003) [2024-06-24 16:58:50.599675] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=27] start lib cache evict(tenant_id=1003, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:50.599696] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1003, cache_evict_num=0, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:50.599714] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:50.600499] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=51] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:50.606410] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=144, alloc_obj_list=[{obj_id:6, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:7, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:182, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:183, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:195, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:196, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195296}, {obj_id:199, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198764}, {obj_id:232, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197576}, {obj_id:237, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:238, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:242, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:246, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:248, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:250, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:251, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:252, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:253, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:254, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:255, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:256, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190960}, {obj_id:257, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:258, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:259, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:265, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:267, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193914}, {obj_id:268, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:269, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:270, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:271, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:273, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245001}, {obj_id:274, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238477}, {obj_id:278, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303661}, {obj_id:280, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250140}, {obj_id:282, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265464}, {obj_id:283, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260287}, {obj_id:285, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:286, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:287, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:288, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:289, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:290, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:291, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:292, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:293, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:294, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:296, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:297, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:298, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:299, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:300, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:302, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:306, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:307, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:308, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:310, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:311, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:313, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:314, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:315, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192384}, {obj_id:316, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:317, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:318, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179373}, {obj_id:319, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:320, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:321, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:322, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214835}, {obj_id:323, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257749}, {obj_id:324, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257679}, {obj_id:325, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:301211}, {obj_id:326, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:322954}, {obj_id:327, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255184}, {obj_id:328, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253823}, {obj_id:329, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:326827}, {obj_id:330, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262876}, {obj_id:331, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283304}, {obj_id:332, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296168}, {obj_id:333, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:261538}, {obj_id:334, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:285869}, {obj_id:335, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300008}, {obj_id:336, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183813}, {obj_id:337, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215145}, {obj_id:338, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252630}, {obj_id:339, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273088}, {obj_id:340, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280836}, {obj_id:341, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275631}, {obj_id:342, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:284691}, {obj_id:343, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250120}, {obj_id:344, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246226}, {obj_id:345, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247565}, {obj_id:346, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242359}, {obj_id:347, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:348, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:349, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:350, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:351, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265421}, {obj_id:352, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269241}, {obj_id:353, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270506}, {obj_id:354, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276928}, {obj_id:355, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267956}, {obj_id:356, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273080}, {obj_id:357, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280749}, {obj_id:358, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292309}, {obj_id:359, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278185}, {obj_id:360, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288460}, {obj_id:361, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288428}, {obj_id:362, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303857}, {obj_id:363, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:364, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:365, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:366, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:367, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:368, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:369, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419863}, {obj_id:371, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312858}, {obj_id:372, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417607}, {obj_id:373, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:374, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:375, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:376, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:377, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:378, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:379, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:380, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:384, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:385, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200158}, {obj_id:386, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332258}, {obj_id:387, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:388, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:434, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187881}, {obj_id:435, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269004}, {obj_id:436, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:437, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:500, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297770}, {obj_id:686, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175750}, {obj_id:687, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189803}, {obj_id:688, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465848}, {obj_id:689, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461380}, {obj_id:690, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:352652}, {obj_id:691, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:850328}, {obj_id:692, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195368}, {obj_id:693, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276678}, {obj_id:694, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:695, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272832}, {obj_id:696, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242168}]) [2024-06-24 16:58:50.607019] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=604] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:50.611508] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2024-06-24 16:58:50.614459] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82700000, replace_num=100000) [2024-06-24 16:58:50.614496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:50.616428] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219530616144000, start_id=1719219530616144000, end_id=1719219530616144001) [2024-06-24 16:58:50.616637] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB7F-0-0] [lt=31][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103426707990, cache_obj->added_lc()=false, cache_obj->get_object_id()=9375, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:50.621709] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:50.621762] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=13] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:50.625038] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C357-0-0] [lt=53] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219529540020, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:50.625083] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C357-0-0] [lt=43] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219529542041, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:50.625108] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C357-0-0] [lt=24] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1719213093}, renew_time:1719219529543950, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219529543942, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:50.625141] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C357-0-0] [lt=32] [LS_LOCATION]dump tenant ls location caches(tenant_id=1003, tenant_ls_locations=[{cache_key:{tenant_id:1003, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219529545783, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:50.625163] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [162300][DumpLSLoc][T0][YB42AC141156-00061B9D8A60C357-0-0] [lt=21] [LS_LOCATION]dump tenant ls location caches(tenant_id=1004, tenant_ls_locations=[{cache_key:{tenant_id:1004, ls_id:{id:1}, cluster_id:1719213093}, renew_time:1719219529547682, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}, {cache_key:{tenant_id:1004, ls_id:{id:1001}, cluster_id:1719213093}, renew_time:1719219529547688, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}]}]) [2024-06-24 16:58:50.648202] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10764C9-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:50.649802] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10764CA-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:50.654076] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8433-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:50.655115] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1003, server_version={version:{val:1719219530438748000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=216359, in_cluster_service=true, cluster_version={val:1719219530356383000, v:0}, min_cluster_version={val:1719219530356383000, v:0}, max_cluster_version={val:1719219530356383000, v:0}, get_cluster_version_err=0, cluster_version_delta=298724, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60013, succ_cluster_heartbeat_count=9, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219471621660000, v:0}, local_cluster_delta=59033447, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:50.657091] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8435-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:50.658858] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10764DF-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:50.662114] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.664899] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1719219530664895, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-06-24 16:58:50.667064] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=12] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13758, offset=3455896}, end_cursor:ObLogCursor{file_id=1, log_id=13759, offset=3456169}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d38050, len:1128, log_data_len:273, seq:13758, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:50.669948] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219530668944000, start_id=1719219530668944000, end_id=1719219530668944001) [2024-06-24 16:58:50.670057] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8272, avg_group_log_size=486) [2024-06-24 16:58:50.670097] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8806) [2024-06-24 16:58:50.670412] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8272) [2024-06-24 16:58:50.670465] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8272) [2024-06-24 16:58:50.670505] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=382, avg_log_submit_to_slide_time=395) [2024-06-24 16:58:50.671591] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D919-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219530671059000, start_id=1719219530671059000, end_id=1719219530671059001) [2024-06-24 16:58:50.672663] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=20] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13759, offset=3456169}, end_cursor:ObLogCursor{file_id=1, log_id=13760, offset=3456434}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d40050, len:855, log_data_len:265, seq:13759, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:50.674583] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=397, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:50.674578] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1211) [2024-06-24 16:58:50.674611] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:50.674653] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:50.674683] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=485, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:50.674703] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:50.679121] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8453-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:50.680884] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076505-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.681193] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1772, avg_group_log_size=161) [2024-06-24 16:58:50.681226] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1772) [2024-06-24 16:58:50.681672] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=14, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=448, avg_log_submit_to_slide_time=457) [2024-06-24 16:58:50.683356] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076509-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:50.685966] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:50.686075] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:50.686285] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:50.686351] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:50.686465] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.686520] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:50.686601] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:50.686716] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [658][T1002_L0_G0][T1002][YB42AC141156-00061B9D9BC152FD-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:50.692659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283379331072, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:50.698852] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A847B-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:50.700707] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=29] gc stale ls task succ [2024-06-24 16:58:50.714524] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1719219530468315000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=246203, in_cluster_service=true, cluster_version={val:1719219530415493000, v:0}, min_cluster_version={val:1719219530415493000, v:0}, max_cluster_version={val:1719219530415493000, v:0}, get_cluster_version_err=0, cluster_version_delta=299025, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60304, succ_cluster_heartbeat_count=10, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219444964826000, v:0}, local_cluster_delta=85749692, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:50.720829] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD58-0-0] [lt=26] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:50.728319] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107655C-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:50.729876] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107655E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:50.730390] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219530730186000, start_id=1719219530730186000, end_id=1719219530730186001) [2024-06-24 16:58:50.730470] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=4394, avg_group_log_size=439) [2024-06-24 16:58:50.730496] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4394) [2024-06-24 16:58:50.730874] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=380, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:50.730908] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=17, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:50.731157] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=26] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:50.757157] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219530756564000, start_id=1719219530756564000, end_id=1719219530756564001) [2024-06-24 16:58:50.762172] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.763521] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=41642, mem_used=158060544) [2024-06-24 16:58:50.773754] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10765B3-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:50.774687] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1635) [2024-06-24 16:58:50.774709] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1211) [2024-06-24 16:58:50.774748] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=456, avg_log_submit_to_slide_time=467) [2024-06-24 16:58:50.781161] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2741, avg_group_log_size=249) [2024-06-24 16:58:50.781186] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2741) [2024-06-24 16:58:50.781570] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=2741) [2024-06-24 16:58:50.781614] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=2741) [2024-06-24 16:58:50.781674] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=416, avg_log_submit_to_slide_time=429) [2024-06-24 16:58:50.786524] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.794468] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219530793578000, start_id=1719219530793578000, end_id=1719219530793578001) [2024-06-24 16:58:50.794547] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:50.794586] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:50.795058] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=407, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:50.795091] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:50.795119] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:50.795135] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=11] [APPLY STAT CB APPEND COST TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=31, this=0x7f46f1dd4280, extra_info="") [2024-06-24 16:58:50.795147] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=11] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=431, this=0x7f46f1dd44b0, extra_info="") [2024-06-24 16:58:50.795153] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=6] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=0, this=0x7f46f1dd46e0, extra_info="") [2024-06-24 16:58:50.795154] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=472, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:50.795159] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=6] [APPLY STAT CB EXECUTE TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=-508, this=0x7f46f1dd4910, extra_info="") [2024-06-24 16:58:50.795167] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=8] [APPLY STAT CB TOTAL TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=-45, this=0x7f46f1dd4b40, extra_info="") [2024-06-24 16:58:50.795169] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=25, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:50.812297] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:50.812341] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=30] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:50.812378] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=22] cannot_recycle_log_size statistics(cannot_recycle_log_size=53515124, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:50.814604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:50.816614] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219530815862000, start_id=1719219530815862000, end_id=1719219530815862001) [2024-06-24 16:58:50.823184] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=46] LogLoopThread round_cost_time(us)(round_cost_time=15) [2024-06-24 16:58:50.827426] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=14] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=34, mem_used=49913856) [2024-06-24 16:58:50.827464] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=25] release old cannot free more memory [2024-06-24 16:58:50.827478] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=53, size_used=0, mem_used=49913856) [2024-06-24 16:58:50.841162] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=61] BlockGCTimerTask success(ret=0, cost_time_us=13, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:50.856070] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A84ED-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219530856031000, start_id=1719219530856031000, end_id=1719219530856031001) [2024-06-24 16:58:50.857035] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD191-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:50.857208] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=22] current monitor number(seq_=-1) [2024-06-24 16:58:50.862197] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.867048] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219530866633000, start_id=1719219530866633000, end_id=1719219530866633001) [2024-06-24 16:58:50.867090] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=36] ts response task statistics(alloc_count=248802, free_count=124400) [2024-06-24 16:58:50.867114] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=12] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219530867030], gts:1719219530866633000, latest_srr:[mts=1719219530867030]}) [2024-06-24 16:58:50.867152] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=414, get_gts_with_stc_cnt=66, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:50.867172] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219530867136], gts:1719219530866633000, latest_srr:[mts=1719219530867136]}) [2024-06-24 16:58:50.867199] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=8137, get_gts_with_stc_cnt=32, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=30, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:50.867214] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219530867187], gts:1719219530866633000, latest_srr:[mts=1719219530867187]}) [2024-06-24 16:58:50.867239] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=13] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219530867228], gts:1719219530866633000, latest_srr:[mts=1719219530867228]}) [2024-06-24 16:58:50.867356] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1719219530501049000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=366300, in_cluster_service=true, cluster_version={val:1719219530365899000, v:0}, min_cluster_version={val:1719219530365899000, v:0}, max_cluster_version={val:1719219530365899000, v:0}, get_cluster_version_err=0, cluster_version_delta=501450, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60231, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219385327519000, v:0}, local_cluster_delta=145539830, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:50.868957] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219530868752000, start_id=1719219530868752000, end_id=1719219530868752001) [2024-06-24 16:58:50.870250] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10765CF-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219530869812000, start_id=1719219530869812000, end_id=1719219530869812001) [2024-06-24 16:58:50.873542] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.873648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.873745] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.873866] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.873941] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874218] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874306] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874313] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874314] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874377] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874459] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874467] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874481] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874485] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874638] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874666] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=66] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874674] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874679] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874717] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874749] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874786] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874804] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874852] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874853] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.874991] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:50.886581] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.892519] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1004, server_version={version:{val:1719219530471487002, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=421023, in_cluster_service=true, cluster_version={val:1719219530471487001, v:0}, min_cluster_version={val:1719219530471487001, v:0}, max_cluster_version={val:1719219530471487001, v:0}, get_cluster_version_err=0, cluster_version_delta=421023, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60056, succ_cluster_heartbeat_count=6, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219412155330001, v:0}, local_cluster_delta=118737180, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:50.893763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283377233920, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:50.912263] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:50.930763] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219530930002000, start_id=1719219530930002000, end_id=1719219530930002001) [2024-06-24 16:58:50.953255] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=41] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:50.957373] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219530956427000, start_id=1719219530956427000, end_id=1719219530956427001) [2024-06-24 16:58:50.962256] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.962601] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:50.968196] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1586][T1003_LCLSender][T1003][Y0-0000000000000000-0-0] [lt=40] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47041fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:50.974355] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:50.974402] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=35] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1635, avg_group_log_size=163) [2024-06-24 16:58:50.974429] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1635) [2024-06-24 16:58:50.974451] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:50.974485] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:50.974825] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=374, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:50.986644] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:50.994446] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1719219530994392000, start_id=1719219530994392000, end_id=1719219530994392001) [2024-06-24 16:58:50.995068] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=36] get_max_applied_scn(scn={val:1719219530866633000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:57990917}, palf_committed_end_scn_:{val:1719219530866633001, v:0}, last_check_scn_:{val:1719219530866633001, v:0}, max_applied_cb_scn_:{val:1719219530866633000, v:0}}) [2024-06-24 16:58:50.995110] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=39] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213369678630001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:51.003576] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:51.012595] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:51.012678] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=52] get_max_applied_scn(scn={val:1719219530930002000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:53515831}, palf_committed_end_scn_:{val:1719219530930002000, v:0}, last_check_scn_:{val:1719219530930002000, v:0}, max_applied_cb_scn_:{val:1719219530930002000, v:0}}) [2024-06-24 16:58:51.012718] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:51.014734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:51.015066] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=99] succ to get rec scn(*this={this:0x7f47b3e04030, ls_id:{id:1}, tenant_id:1, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216858758544000, v:0}, last_push_gc_task_ts_:1719216859472314, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1025}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.015105] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47b6924080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216859475873, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47b6924080, snapshot_version:{val:1719216859475873, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.015152] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=40] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:51.015317] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A85CF-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.015368] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:51.015493] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=120] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f47b684c1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f47b685a0d0, memtable_head:3, memtable_tail:4, t3m:0x7f47ded72030, tables:[null, null, null, 0x7f47b6914080, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215058499657, tx_data_table:0x7f47b685bb90, ls_tablet_svr:0x7f47b684c190}, min_rec_scn={val:1719216859633263000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:51.015548] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=47] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:51.015573] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1719219522058160001, v:0}) [2024-06-24 16:58:51.015590] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.015610] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.015639] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216859633263000, v:0}, checkpoint_scn_in_ls_meta={val:1719216859633263000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:51.015671] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:51.015698] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:51.015721] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:51.016707] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=71] get number(ret=0, service_type_=0, range=1, base_id=1719219531016489000, start_id=1719219531016489000, end_id=1719219531016489001) [2024-06-24 16:58:51.018477] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A85D1-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.023998] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042877-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.026990] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A85DB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.029186] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16511, offset=3762641}, end_cursor:ObLogCursor{file_id=1, log_id=16512, offset=3762914}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d44050, len:1583, log_data_len:273, seq:16511, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:51.030182] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076686-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.033298] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90A-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219531032245000, start_id=1719219531032245000, end_id=1719219531032245001) [2024-06-24 16:58:51.033397] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90A-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8424, avg_group_log_size=601) [2024-06-24 16:58:51.033427] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90A-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8424) [2024-06-24 16:58:51.033758] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8424) [2024-06-24 16:58:51.033810] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8424) [2024-06-24 16:58:51.033854] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=447, avg_log_submit_to_slide_time=459) [2024-06-24 16:58:51.034436] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16512, offset=3762914}, end_cursor:ObLogCursor{file_id=1, log_id=16513, offset=3763179}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d48050, len:1310, log_data_len:265, seq:16512, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:51.035245] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219531035240, bytes: 171023002, bw: 0.019870 MB/s, add_ts: 1007601, add_bytes: 20994 [2024-06-24 16:58:51.036560] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:51.036596] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:51.036650] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] cannot_recycle_log_size statistics(cannot_recycle_log_size=348882153, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:51.046476] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] tx gc loop thread is running(MTL_ID()=1) [2024-06-24 16:58:51.046508] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=30] try gc retain ctx [2024-06-24 16:58:51.048777] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219538711542000, latest_log_ts:{val:1719219522058160001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:51.049330] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=426, avg_log_submit_to_slide_time=440) [2024-06-24 16:58:51.055584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107669E-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.056154] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:51.058587] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8607-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:51.062315] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.062460] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 402.50) [2024-06-24 16:58:51.062496] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:51.062590] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 393.50) [2024-06-24 16:58:51.062606] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:51.062656] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062695] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062710] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062746] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062760] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062774] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062786] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062800] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062814] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062828] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062842] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062860] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062874] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062888] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.062901] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:51.063135] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A860C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:51.065964] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:51.066072] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:51.066263] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:51.066327] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:51.066483] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:51.066555] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:51.066662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8611-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:51.069463] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219531069225000, start_id=1719219531069225000, end_id=1719219531069225001) [2024-06-24 16:58:51.070077] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213342229334001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:51.077887] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10766BB-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.086697] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.094293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283373039616, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:51.095789] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=57] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.096097] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.096636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.096642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097003] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097065] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097070] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097070] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097118] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097144] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097163] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=55] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097173] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097169] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097280] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097398] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097404] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097417] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097520] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097597] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=58] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097599] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097603] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097638] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097673] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=51] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097678] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=80] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097693] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097728] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097786] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097817] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097824] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097831] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097830] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097837] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097836] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.097878] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=58] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=1, size_used=1177, mem_used=4159488) [2024-06-24 16:58:51.098060] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=46] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=100] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098660] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098693] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098706] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098759] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098762] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098821] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098829] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.098880] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.116265] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10766E6-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:51.117411] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=18521992, clean_num=201326) [2024-06-24 16:58:51.119325] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A866C-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.130799] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219531130540000, start_id=1719219531130540000, end_id=1719219531130540001) [2024-06-24 16:58:51.131349] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=42, stat_interval=5000000, avg (count/cost)=35, this=0x7f47b68f8280, extra_info="") [2024-06-24 16:58:51.131377] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=27] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=42, stat_interval=5000000, avg (count/cost)=456, this=0x7f47b68f84b0, extra_info="") [2024-06-24 16:58:51.131391] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=13] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=42, stat_interval=5000000, avg (count/cost)=0, this=0x7f47b68f86e0, extra_info="") [2024-06-24 16:58:51.131405] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=42, stat_interval=5000000, avg (count/cost)=-504, this=0x7f47b68f8910, extra_info="") [2024-06-24 16:58:51.131419] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=42, stat_interval=5000000, avg (count/cost)=-12, this=0x7f47b68f8b40, extra_info="") [2024-06-24 16:58:51.133965] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:465) [1305][T1004_SSTableDe][T1004][Y0-0000000000000000-0-0] [lt=21] skip defragment task(ret=0, need_defragment=false) [2024-06-24 16:58:51.134005] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:507) [1305][T1004_SSTableDe][T1004][Y0-0000000000000000-0-0] [lt=37] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=5) [2024-06-24 16:58:51.134021] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:525) [1305][T1004_SSTableDe][T1004][Y0-0000000000000000-0-0] [lt=15] successfully defragment data blocks(rewrite_cnt=0) [2024-06-24 16:58:51.134042] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:697) [1305][T1004_SSTableDe][T1004][Y0-0000000000000000-0-0] [lt=18] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=0, total_skip_cnt=0, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2024-06-24 16:58:51.135223] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=12] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:51.157266] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138AF-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336819486618041992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.884401192498512501e+01) [2024-06-24 16:58:51.157491] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1719219531156949000, start_id=1719219531156949000, end_id=1719219531156949001) [2024-06-24 16:58:51.162374] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.171146] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A86A0-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:51.174528] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:51.174550] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E7-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:51.174585] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E7-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:51.174904] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:51.174932] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:51.174960] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=446, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:51.174978] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:51.174999] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1766) [2024-06-24 16:58:51.175027] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=475, avg_log_submit_to_slide_time=485) [2024-06-24 16:58:51.175740] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D902-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:51.175778] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D902-0-0] [lt=35] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:51.176388] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=30] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:51.178772] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1187][T1002_TTLTablet][T1002][YB42AC141156-00061B9D9740C34E-0-0] [lt=34] finish reload tenant task(local_tenant_task_={tenant_id:1002, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:51.186756] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.188270] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D432-0-0] [lt=27] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.188700] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D434-0-0] [lt=24] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.194594] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=105] get number(ret=0, service_type_=0, range=1, base_id=1719219531193932000, start_id=1719219531193932000, end_id=1719219531193932001) [2024-06-24 16:58:51.202263] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:51.214828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:51.216943] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] submit log success(service_type_=0, last_id=1719219547830421000, limited_id=1719219547830421000) [2024-06-24 16:58:51.216970] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] submit log with lock success(service_type_=0, last_id=1719219547830421000, limited_id=1719219547830421000) [2024-06-24 16:58:51.216987] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219531216126000, start_id=1719219531216126000, end_id=1719219531216126001) [2024-06-24 16:58:51.217326] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1719219547830421000, latest_scn={val:1719219531216126001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219547830421000, latest_log_ts:{val:1719219531216126001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:51.217402] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=75] handle submit callback(service_type_=0, success=true, used_ts=460, log_ts={val:1719219531216126001, v:0}, limited_id=1719219547830421000) [2024-06-24 16:58:51.217422] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:51.217442] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:51.217694] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219531217184000, start_id=1719219531217184000, end_id=1719219531217184001) [2024-06-24 16:58:51.232732] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D482-0-0] [lt=13] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.246643] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=112] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=3, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:51.246679] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:51.247057] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:51.247070] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=444, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:51.247078] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=24, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:51.256158] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:51.257940] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:51.258044] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526802034000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:51.262433] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.269673] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=107] get number(ret=0, service_type_=0, range=1, base_id=1719219531268979000, start_id=1719219531268979000, end_id=1719219531268979001) [2024-06-24 16:58:51.269993] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:146) [1393][T1004_Compactio][T1004][YB42AC141156-00061B9D99B0C1C6-0-0] [lt=29] InfoPoolResizeTask(cost_ts=26) [2024-06-24 16:58:51.281784] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1644) [2024-06-24 16:58:51.286815] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.297093] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:103671, max_lsn:517747928, max_scn:{val:1719219530869812004, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:517747928}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:475804888}}, last_submit_lsn:{lsn:517747806}, last_submit_end_lsn:{lsn:517747928}, last_submit_log_id:103671, last_submit_log_pid:1, max_flushed_lsn:{lsn:517747806}, max_flushed_end_lsn:{lsn:517747928}, max_flushed_log_pid:1, committed_end_lsn:{lsn:517747928}, last_slide_log_id:103671, last_slide_scn:{val:1719219530869812004, v:0}, last_slide_lsn:{lsn:517747806}, last_slide_end_lsn:{lsn:517747928}, last_slide_log_pid:1, last_slide_log_accum_checksum:1293653704, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4736730530}, [StateMgr]={this:0x7f47367342b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:103672, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213349729967, palf_role_change_cb:0x7f473673acb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4736731c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213342229334002, v:0}, base_lsn_for_block_gc:{lsn:201314304}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:201314304}, prev_log_info:{log_id:-1, lsn:{lsn:18446744073709551615}, scn:{val:18446744073709551615, v:3}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213342229334001, v:0}}}, log_meta_storage:{log_tail:{lsn:24576}, readable_log_tail:{lsn:24576}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:536838144}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1001/meta", dir_fd:674, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67080192, block_header_serialize_buf_:0x7f4736736478, flashback_version:0}, log_storage:{log_tail:{lsn:517747928}, readable_log_tail:{lsn:517747928}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:469733376}, min_scn:{val:1719215616323502002, v:0}, curr_block_id:7, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1001/log", dir_fd:675, min_block_id:0, max_block_id:8, curr_writable_block_id:7}, logical_block_size_:67104768, curr_block_writable_size_:19090216, block_header_serialize_buf_:0x7f4736738138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213349730110, this:0x7f47367349f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213349730486, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4736734430}) [2024-06-24 16:58:51.297458] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=359] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219531281801, last_flushed_end_lsn:{lsn:517747928}}]) [2024-06-24 16:58:51.297490] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=28] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=103672, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219531281801, last_flushed_end_lsn:{lsn:517747928}}]) [2024-06-24 16:58:51.301804] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:51.301833] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:51.301864] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=70407311, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:51.315226] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:51.316888] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succ to get rec scn(*this={this:0x7f474be04030, ls_id:{id:1}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215719054755000, v:0}, last_push_gc_task_ts_:1719216936767864, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.316923] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739404080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216936773978, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739404080, snapshot_version:{val:1719216936773978, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.316962] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=32] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:51.317082] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219528568202000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:51.317182] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f4753c761b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f4753c840d0, memtable_head:2, memtable_tail:3, t3m:0x7f4782d1e030, tables:[null, null, 0x7f4753dced90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215135780086, tx_data_table:0x7f4753c85b90, ls_tablet_svr:0x7f4753c76190}, min_rec_scn={val:1719216939041208000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:51.317224] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:51.317243] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=0, rec_log_ts={val:1719219529824381001, v:0}) [2024-06-24 16:58:51.317254] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.317270] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=7] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216939041208000, v:0}, checkpoint_scn_in_ls_meta={val:1719216939041208000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:51.317294] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:51.317315] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:51.317945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283373039616, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:51.318956] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] succ to get rec scn(*this={this:0x7f474beb6030, ls_id:{id:1001}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213748817809002, v:0}, last_push_gc_task_ts_:1719215150704743, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:580}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.318980] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739405350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215150709832, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739405350, snapshot_version:{val:1719215150709832, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:51.319006] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:51.319058] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219528568202000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:51.319136] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=76] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f4736709790}, min_rec_scn={val:1719215150797158000, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:51.319153] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213342229334001, v:0}) [2024-06-24 16:58:51.319170] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215150797158000, v:0}, checkpoint_scn_in_ls_meta={val:1719215150797158000, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:51.319187] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:201314304}, new_base_lsn={lsn:201314304}, lsn={lsn:201314304}) [2024-06-24 16:58:51.319202] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:201314304}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:51.319214] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:51.327489] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112442, mem_used=264127488) [2024-06-24 16:58:51.330870] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219531330063000, start_id=1719219531330063000, end_id=1719219531330063001) [2024-06-24 16:58:51.330973] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107681A-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.332309] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2024-06-24 16:58:51.333888] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042967-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219531333236000, start_id=1719219531333236000, end_id=1719219531333236001) [2024-06-24 16:58:51.334098] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [1355][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1004, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:51.334222] WDIAG read_multi_row (ob_table_access_helper.h:238) [1355][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=41][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1004, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:51.334337] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107681C-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.334402] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:221) [1355][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=23] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:51.334907] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD1A0-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219531334296000, start_id=1719219531334296000, end_id=1719219531334296001) [2024-06-24 16:58:51.335584] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:51.335725] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=140] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:51.335747] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:51.335826] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=78] get_replay_process success(id={id:1001}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:51.335885] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [1315][T1004_ReplayPro][T1004][Y0-0000000000000000-0-0] [lt=14] dump tenant replay process(tenant_id=1004, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:51.337428] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [383][T1002_ArcSender][T1002][YB42AC141156-00061B9D8D10C0E5-0-0] [lt=31][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:51.340516] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8786-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.340732] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076829-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219531340630000, start_id=1719219531340630000, end_id=1719219531340630001) [2024-06-24 16:58:51.343858] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8788-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.344312] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:51.347179] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076831-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4801, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.354383] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=52] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:51.357530] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219531357509000, start_id=1719219531357509000, end_id=1719219531357509001) [2024-06-24 16:58:51.362492] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.367947] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219531367026000, start_id=1719219531367026000, end_id=1719219531367026001) [2024-06-24 16:58:51.368002] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:51.374682] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:51.374729] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:51.374781] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107684D-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.377812] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042991-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:51.381501] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:51.381540] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:51.381862] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=342, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:51.381883] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:51.381905] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:51.381930] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=413, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:51.381948] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:51.382664] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87BF-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:51.385398] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:51.385518] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:51.385742] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:51.385812] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:51.385979] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:51.386055] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:51.386159] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87C5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:51.386874] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.394640] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219531394419000, start_id=1719219531394419000, end_id=1719219531394419001) [2024-06-24 16:58:51.397772] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A87DA-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.409736] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D448-0-0] [lt=23] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.414925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:51.416874] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219531416524000, start_id=1719219531416524000, end_id=1719219531416524001) [2024-06-24 16:58:51.419854] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B3-0-0] [lt=49][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:51.419881] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B3-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:51.422050] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=129881, mem_used=326519808) [2024-06-24 16:58:51.425560] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=11] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:51.425589] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=12] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1236) [2024-06-24 16:58:51.439783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A880B-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:51.442828] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A880D-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.455385] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:465) [1562][T1003_SSTableDe][T1003][Y0-0000000000000000-0-0] [lt=22] skip defragment task(ret=0, need_defragment=false) [2024-06-24 16:58:51.455428] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:507) [1562][T1003_SSTableDe][T1003][Y0-0000000000000000-0-0] [lt=39] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=5) [2024-06-24 16:58:51.455448] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:525) [1562][T1003_SSTableDe][T1003][Y0-0000000000000000-0-0] [lt=19] successfully defragment data blocks(rewrite_cnt=0) [2024-06-24 16:58:51.455467] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:697) [1562][T1003_SSTableDe][T1003][Y0-0000000000000000-0-0] [lt=15] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=0, total_skip_cnt=0, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2024-06-24 16:58:51.459057] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:231) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=16] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"8GB", log_disk_size:"24GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}, {unit:unit_id:1002, resource_pool_id:1002, unit_group_id:1002, zone:"zone1", server:"172.20.17.86:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"16GB", log_disk_size:"48GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, pool:{resource_pool_id:1002, name:"ocp_monitor_pool", unit_count:1, unit_config_id:1002, zone_list:["zone1"], tenant_id:1004, replica_type:0}}]) [2024-06-24 16:58:51.459177] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:810) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=111] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2024-06-24 16:58:51.459198] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:705) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=18] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, user_resource={min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, unit_resource={min_cpu:4, max_cpu:4, memory_size:"8GB", log_disk_size:"24GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}) [2024-06-24 16:58:51.459234] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:125) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=33] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}) [2024-06-24 16:58:51.459284] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:810) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=46] jx_debug: get tenant compatibility mode(tenant_id=1004, compat_mode=0) [2024-06-24 16:58:51.459297] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:705) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=13] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, user_resource={min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}, unit_resource={min_cpu:4, max_cpu:4, memory_size:"16GB", log_disk_size:"48GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}) [2024-06-24 16:58:51.459323] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:125) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=25] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}, user_config={tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:0, is_removed:false}) [2024-06-24 16:58:51.462551] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.463251] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=32] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2024-06-24 16:58:51.465308] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=30] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2024-06-24 16:58:51.467302] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=30] refresh_resource_function_mapping_rule(tenant_id=1, plan=, rules=[]) [2024-06-24 16:58:51.467334] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=30] refresh resource mapping rule success(tenant_id=1, plan=) [2024-06-24 16:58:51.469318] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C356-0-0] [lt=16] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:51.469503] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C356-0-0] [lt=29] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:51.469530] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C356-0-0] [lt=24] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:51.469663] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219531469081000, start_id=1719219531469081000, end_id=1719219531469081001) [2024-06-24 16:58:51.469741] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:51.469775] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:51.470131] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=361, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:51.470163] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:51.470176] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=5, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:51.470190] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=435, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:51.470197] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=20, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:51.473283] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=22] refresh resource plan success(tenant_id=1001, plan_name=, directives=[]) [2024-06-24 16:58:51.475184] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=27] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2024-06-24 16:58:51.477129] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=30] refresh_resource_function_mapping_rule(tenant_id=1001, plan=, rules=[]) [2024-06-24 16:58:51.477158] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=28] refresh resource mapping rule success(tenant_id=1001, plan=) [2024-06-24 16:58:51.478931] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C356-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2024-06-24 16:58:51.479116] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C356-0-0] [lt=26] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:51.479137] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C356-0-0] [lt=18] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:51.481582] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:51.481620] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:51.481950] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1644) [2024-06-24 16:58:51.482181] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=356, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:51.482210] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=17, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:51.482228] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:51.482248] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=423, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:51.482262] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=23, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:51.482315] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:51.482694] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=19] refresh resource plan success(tenant_id=1002, plan_name=, directives=[]) [2024-06-24 16:58:51.484846] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=26] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2024-06-24 16:58:51.486778] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=27] refresh_resource_function_mapping_rule(tenant_id=1002, plan=, rules=[]) [2024-06-24 16:58:51.486807] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=28] refresh resource mapping rule success(tenant_id=1002, plan=) [2024-06-24 16:58:51.486938] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.488749] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C356-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:51.488935] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C356-0-0] [lt=27] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:51.488959] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C356-0-0] [lt=22] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:51.492465] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=20] refresh resource plan success(tenant_id=1003, plan_name=, directives=[]) [2024-06-24 16:58:51.494262] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1003, plan=, user_rules=[]) [2024-06-24 16:58:51.495925] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A884F-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:51.495961] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=24] refresh_resource_function_mapping_rule(tenant_id=1003, plan=, rules=[]) [2024-06-24 16:58:51.495988] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=25] refresh resource mapping rule success(tenant_id=1003, plan=) [2024-06-24 16:58:51.496710] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [162824][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=37] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:51.497567] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C356-0-0] [lt=11] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2024-06-24 16:58:51.497748] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C356-0-0] [lt=23] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:51.497767] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C356-0-0] [lt=17] tenant dfc status(ret=0, get_tenant_id()=1003, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:51.499219] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:51.500998] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:51.501108] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526749170000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:51.501137] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:122) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=18] refresh resource plan success(tenant_id=1004, plan_name=, directives=[]) [2024-06-24 16:58:51.502931] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:159) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=22] refresh resource user mapping rule(tenant_id=1004, plan=, user_rules=[]) [2024-06-24 16:58:51.504620] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:196) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=25] refresh_resource_function_mapping_rule(tenant_id=1004, plan=, rules=[]) [2024-06-24 16:58:51.504658] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1004, plan=) [2024-06-24 16:58:51.506419] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C356-0-0] [lt=36] trace tenant dfc parameters(max_parallel_cnt_=40, max_blocked_buffer_size_=13107200, max_buffer_size_=26214400) [2024-06-24 16:58:51.506591] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C356-0-0] [lt=24] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2024-06-24 16:58:51.506609] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C356-0-0] [lt=16] tenant dfc status(ret=0, get_tenant_id()=1004, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=40, get_max_blocked_buffer_size()=13107200, get_max_buffer_size()=26214400, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2024-06-24 16:58:51.506659] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:108) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=31] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, {tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, {tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}], ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.506740] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=70] finish set nway(tenant_id_=1, nway=4) [2024-06-24 16:58:51.506758] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=4, new_tma_limit=1073741800, pre_tma_limit=1073741800, cur_memstore_limit_percent=50, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}) [2024-06-24 16:58:51.506786] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C356-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.740799999237060547e+03, this=0x7f47dedb4170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=8703, Resource Limit(MB)=8703, Throttle Trigger(MB)=5222, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=3.132550312791559585e-03) [2024-06-24 16:58:51.506813] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1][YB42AC141156-00061B9D86B0C356-0-0] [lt=26] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2024-06-24 16:58:51.506834] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=11] finish set nway(tenant_id_=1002, nway=4) [2024-06-24 16:58:51.506845] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=10] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=4, new_tma_limit=4509715620, pre_tma_limit=4509715620, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}) [2024-06-24 16:58:51.506869] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C356-0-0] [lt=22] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=5.734399948120117188e+02, this=0x7f4782dd6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2867, Resource Limit(MB)=2867, Throttle Trigger(MB)=1720, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=2.654160334594075632e-01) [2024-06-24 16:58:51.506889] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1002][YB42AC141156-00061B9D86B0C356-0-0] [lt=20] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2024-06-24 16:58:51.506901] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=8] finish set nway(tenant_id_=1001, nway=1) [2024-06-24 16:58:51.506914] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=12] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}) [2024-06-24 16:58:51.506935] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C356-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f4764fea170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2024-06-24 16:58:51.506956] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1001][YB42AC141156-00061B9D86B0C356-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2024-06-24 16:58:51.506967] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=7] finish set nway(tenant_id_=1004, nway=4) [2024-06-24 16:58:51.506977] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=10] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1004, nway=4, new_tma_limit=7730941100, pre_tma_limit=7730941100, cur_memstore_limit_percent=50, tenant_config={tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}) [2024-06-24 16:58:51.507000] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C356-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.474559993743896484e+03, this=0x7f47285d6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=7372, Resource Limit(MB)=7372, Throttle Trigger(MB)=4423, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.083503486695933209e-03) [2024-06-24 16:58:51.507019] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1004][YB42AC141156-00061B9D86B0C356-0-0] [lt=19] succ to set_memstore_threshold of memstore allocator(tenant_id=1004, ret=0) [2024-06-24 16:58:51.507031] INFO set_nway (ob_tenant_mutil_allocator.cpp:357) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=7] finish set nway(tenant_id_=1003, nway=1) [2024-06-24 16:58:51.507042] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=11] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1003, nway=1, new_tma_limit=1030792140, pre_tma_limit=1030792140, cur_memstore_limit_percent=40, tenant_config={tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}) [2024-06-24 16:58:51.507064] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:266) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C356-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.310719985961914062e+02, this=0x7f4703dde170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=655, Resource Limit(MB)=655, Throttle Trigger(MB)=393, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=9.610614047311770491e+01) [2024-06-24 16:58:51.507084] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [162585][OmtNodeBalancer][T1003][YB42AC141156-00061B9D86B0C356-0-0] [lt=20] succ to set_memstore_threshold of memstore allocator(tenant_id=1003, ret=0) [2024-06-24 16:58:51.508597] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=7] cal_all_part_disk_default_percentage succ(data_dir="/data/1/sstable", clog_dir="/data/1/clog", shared_mode=true, data_disk_total_size=2396821651456, data_disk_default_percentage=60, clog_disk_total_size=2396821651456, clog_disk_default_percentage=30) [2024-06-24 16:58:51.508639] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=41] decide disk size finished(suggested_disk_size=804232626176, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2396821651456, disk_size=804232626176) [2024-06-24 16:58:51.508656] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=17] get_log_disk_info_in_config(suggested_data_disk_size=890131972096, suggested_clog_disk_size=804232626176, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=804232626176, log_disk_percentage=0, total_log_disk_size=2396821651456) [2024-06-24 16:58:51.508676] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:785) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=16] try_resize success(ret=0, log_disk_size=804232626176, total_log_disk_size=2396821651456, this={dir::"/data/1/clog/log_pool", dir_fd:14, meta_fd:15, log_pool_meta:{curr_total_size:804232626176, next_total_size:804232626176, status:0}, min_block_id:23, max_block_id:11984, min_log_disk_size_for_all_tenants_:95563022336, is_inited:true}) [2024-06-24 16:58:51.508701] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:132) [162585][OmtNodeBalancer][T0][YB42AC141156-00061B9D86B0C356-0-0] [lt=23] refresh tenant config(tenants=[1, 1001, 1002, 1003, 1004], ret=0) [2024-06-24 16:58:51.518008] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [1312][T1004_DupTbLeas][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:51.518116] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [1312][T1004_DupTbLeas][T1004][Y0-0000000000000000-0-0] [lt=32][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1004 and flag like "%DUPLICATE%", tenant_id=1004, exec_tenant_id=1003, need_member_list=false) [2024-06-24 16:58:51.518446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283366748160, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:51.520007] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E945-0-0] [lt=29] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:51.520177] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E945-0-0] [lt=31][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:51.527741] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=20] start to print blacklist info [2024-06-24 16:58:51.527926] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=27] ls blacklist refresh finish(cost_time=11719) [2024-06-24 16:58:51.531059] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219531530268000, start_id=1719219531530268000, end_id=1719219531530268001) [2024-06-24 16:58:51.531550] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3827) [2024-06-24 16:58:51.531597] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3827) [2024-06-24 16:58:51.531757] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219531330063000, v:0}, new_max_version={val:1719219531330063000, v:0}, last_min_version={val:1719219531130540000, v:0}, last_max_version={val:1719219531130540000, v:0}, total_time_us=2682, delta_us=201692) [2024-06-24 16:58:51.531792] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219531330063000, v:0}, min_version={val:1719219531330063000, v:0}, max_version={val:1719219531330063000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:51.550604] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2024-06-24 16:58:51.550648] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=40] start lib cache evict(tenant_id=1002, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:51.550666] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:51.550686] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=18] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:51.557173] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219531556650000, start_id=1719219531556650000, end_id=1719219531556650001) [2024-06-24 16:58:51.557146] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=753, alloc_obj_list=[{obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:206, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:208, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:213, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:215, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:218, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:219, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:221, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:222, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:223, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:224, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:225, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:226, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:227, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:230, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:258, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:259, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207636}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157087}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:262, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417132}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:293, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:297, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178532}, {obj_id:299, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174372}, {obj_id:311, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:312, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:313, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:314, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:315, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:316, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:317, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:318, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:319, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:320, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:370, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:371, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:372, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:373, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:374, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:375, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:376, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:377, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:378, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:394, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217236}, {obj_id:404, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:405, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:431, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200789}, {obj_id:787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:1554, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174647}, {obj_id:1765, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196131}, {obj_id:1767, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180746}, {obj_id:1768, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180053}, {obj_id:1769, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156392}, {obj_id:1770, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185682}, {obj_id:1771, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178754}, {obj_id:1772, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217927}, {obj_id:1773, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182452}, {obj_id:1774, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157145}, {obj_id:1775, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193250}, {obj_id:1776, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156261}, {obj_id:1777, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202011}, {obj_id:1778, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176126}, {obj_id:1779, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:1780, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179533}, {obj_id:1782, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194286}, {obj_id:1783, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191084}, {obj_id:1784, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185716}, {obj_id:1785, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197901}, {obj_id:1786, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203431}, {obj_id:1787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177702}, {obj_id:1788, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197376}, {obj_id:1789, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194100}, {obj_id:1790, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229422}, {obj_id:1791, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342799}, {obj_id:1792, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177856}, {obj_id:1793, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:1794, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:1801, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197017}, {obj_id:1802, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197375}, {obj_id:1803, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192944}, {obj_id:1804, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210981}, {obj_id:1807, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1808, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191543}, {obj_id:1809, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190396}, {obj_id:1810, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179961}, {obj_id:1811, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187508}, {obj_id:1812, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190770}, {obj_id:1814, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174667}, {obj_id:1817, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186991}, {obj_id:1820, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181584}, {obj_id:1822, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201206}, {obj_id:1823, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187930}, {obj_id:1824, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182810}, {obj_id:1826, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205149}, {obj_id:1828, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181586}, {obj_id:1830, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184827}, {obj_id:1832, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173928}, {obj_id:1833, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241466}, {obj_id:1834, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173654}, {obj_id:1835, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174122}, {obj_id:1841, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183277}, {obj_id:1842, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202767}, {obj_id:1843, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184717}, {obj_id:1844, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179338}, {obj_id:1845, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192322}, {obj_id:1846, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186117}, {obj_id:1847, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:243066}, {obj_id:1850, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203203}, {obj_id:1851, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206987}, {obj_id:1854, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202239}, {obj_id:1857, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179623}, {obj_id:1858, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199630}, {obj_id:1859, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181089}, {obj_id:1860, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191144}, {obj_id:1861, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208300}, {obj_id:1862, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207006}, {obj_id:1864, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174459}, {obj_id:1865, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197772}, {obj_id:1866, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195985}, {obj_id:1867, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187545}, {obj_id:1868, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200975}, {obj_id:1869, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190129}, {obj_id:1870, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187648}, {obj_id:1871, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180383}, {obj_id:1872, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176694}, {obj_id:1873, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199714}, {obj_id:1874, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197401}, {obj_id:1875, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211269}, {obj_id:1878, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197823}, {obj_id:1879, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180556}, {obj_id:1880, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186838}, {obj_id:1881, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173640}, {obj_id:1882, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189084}, {obj_id:1883, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182778}, {obj_id:1884, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198543}, {obj_id:1885, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184808}, {obj_id:1886, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192715}, {obj_id:1887, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178511}, {obj_id:1889, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:1890, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190883}, {obj_id:1892, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204317}, {obj_id:1895, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200704}, {obj_id:1897, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180059}, {obj_id:1898, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189670}, {obj_id:1899, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297520}, {obj_id:1900, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180210}, {obj_id:1901, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173929}, {obj_id:1902, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207174}, {obj_id:1904, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180315}, {obj_id:1905, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175944}, {obj_id:1906, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191394}, {obj_id:1907, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205016}, {obj_id:1908, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205015}, {obj_id:1909, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205042}, {obj_id:1910, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183144}, {obj_id:1912, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156278}, {obj_id:1914, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201207}, {obj_id:1915, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205705}, {obj_id:1916, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179043}, {obj_id:1918, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210554}, {obj_id:1919, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211414}, {obj_id:1920, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203461}, {obj_id:1922, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179984}, {obj_id:1924, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194777}, {obj_id:1926, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212517}, {obj_id:1927, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185341}, {obj_id:1928, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211233}, {obj_id:1929, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180552}, {obj_id:1930, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199580}, {obj_id:1932, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200277}, {obj_id:1933, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202039}, {obj_id:1935, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202217}, {obj_id:1938, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:1939, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185428}, {obj_id:1940, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342648}, {obj_id:1941, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184408}, {obj_id:1942, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188029}, {obj_id:1943, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220581}, {obj_id:1944, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186138}, {obj_id:1945, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188109}, {obj_id:1946, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184071}, {obj_id:1947, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297497}, {obj_id:1948, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259587}, {obj_id:1949, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234741}, {obj_id:1950, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230127}, {obj_id:1951, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:1952, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199425}, {obj_id:1953, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204260}, {obj_id:1955, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186747}, {obj_id:1956, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186410}, {obj_id:1957, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180371}, {obj_id:1959, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186746}, {obj_id:1960, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:314579}, {obj_id:1961, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316276}, {obj_id:1962, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179253}, {obj_id:1963, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198957}, {obj_id:1964, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253315}, {obj_id:1965, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194531}, {obj_id:1966, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181919}, {obj_id:1968, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204268}, {obj_id:1969, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:1970, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156216}, {obj_id:1971, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:1973, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206972}, {obj_id:1974, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372622}, {obj_id:1975, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:1976, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:1977, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255312}, {obj_id:1978, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255070}, {obj_id:1979, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281856}, {obj_id:1980, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312870}, {obj_id:1982, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:1983, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210959}, {obj_id:1984, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:1986, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216413}, {obj_id:1987, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:1988, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207457}, {obj_id:1989, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197063}, {obj_id:1990, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202377}, {obj_id:1991, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319848}, {obj_id:1993, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177048}, {obj_id:1994, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179527}, {obj_id:1996, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:390465}, {obj_id:1997, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181650}, {obj_id:1998, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180128}, {obj_id:1999, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175288}, {obj_id:2000, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179784}, {obj_id:2001, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183026}, {obj_id:2002, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179032}, {obj_id:2003, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186850}, {obj_id:2004, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207791}, {obj_id:2005, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188599}, {obj_id:2006, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241706}, {obj_id:2007, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179781}, {obj_id:2008, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189180}, {obj_id:2010, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175346}, {obj_id:2011, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182950}, {obj_id:2012, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178932}, {obj_id:2013, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184319}, {obj_id:2014, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182003}, {obj_id:2015, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:383980}, {obj_id:2016, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175770}, {obj_id:2017, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180015}, {obj_id:2018, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219419}, {obj_id:2019, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204596}, {obj_id:2020, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181397}, {obj_id:2021, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179054}, {obj_id:2022, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156256}, {obj_id:2023, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237344}, {obj_id:2024, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209999}, {obj_id:2025, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230256}, {obj_id:2026, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188496}, {obj_id:2027, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179278}, {obj_id:2028, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192304}, {obj_id:2029, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195605}, {obj_id:2030, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183563}, {obj_id:2031, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182637}, {obj_id:2033, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:392174}, {obj_id:2035, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304600}, {obj_id:2037, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184788}, {obj_id:2038, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185565}, {obj_id:2039, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181321}, {obj_id:2040, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204506}, {obj_id:2041, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:348902}, {obj_id:2042, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222494}, {obj_id:2043, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220331}, {obj_id:2044, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181427}, {obj_id:2045, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226680}, {obj_id:2046, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192432}, {obj_id:2047, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225643}, {obj_id:2048, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174740}, {obj_id:2049, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215812}, {obj_id:2050, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196675}, {obj_id:2051, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179861}, {obj_id:2052, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204953}, {obj_id:2053, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196998}, {obj_id:2054, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179552}, {obj_id:2055, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197192}, {obj_id:2056, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187268}, {obj_id:2057, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185914}, {obj_id:2058, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205463}, {obj_id:2059, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:391976}, {obj_id:2060, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202155}, {obj_id:2061, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207183}, {obj_id:2062, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228354}, {obj_id:2063, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240497}, {obj_id:2064, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182911}, {obj_id:2065, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218028}, {obj_id:2066, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210463}, {obj_id:2067, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176755}, {obj_id:2068, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2069, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198027}, {obj_id:2070, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181248}, {obj_id:2071, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179856}, {obj_id:2072, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185425}, {obj_id:2073, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:365208}, {obj_id:2074, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189692}, {obj_id:2075, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183454}, {obj_id:2076, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238844}, {obj_id:2077, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321800}, {obj_id:2078, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186250}, {obj_id:2079, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196079}, {obj_id:2080, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332305}, {obj_id:2081, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320208}, {obj_id:2082, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251367}, {obj_id:2083, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182508}, {obj_id:2084, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300805}, {obj_id:2085, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178980}, {obj_id:2086, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178916}, {obj_id:2087, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209270}, {obj_id:2088, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184260}, {obj_id:2089, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183375}, {obj_id:2090, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240830}, {obj_id:2091, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201771}, {obj_id:2092, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192848}, {obj_id:2093, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185409}, {obj_id:2094, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185960}, {obj_id:2095, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178833}, {obj_id:2096, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184221}, {obj_id:2098, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186713}, {obj_id:2099, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215730}, {obj_id:2101, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197347}, {obj_id:2102, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193779}, {obj_id:2103, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234706}, {obj_id:2104, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179916}, {obj_id:2105, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204599}, {obj_id:2106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208576}, {obj_id:2107, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196385}, {obj_id:2108, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2109, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2110, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181778}, {obj_id:2114, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210988}, {obj_id:2115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209186}, {obj_id:2116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197363}, {obj_id:2117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223906}, {obj_id:2118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201491}, {obj_id:2119, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292238}, {obj_id:2120, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207205}, {obj_id:2122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226896}, {obj_id:2123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181523}, {obj_id:2124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213117}, {obj_id:2125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:2126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179447}, {obj_id:2127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183182}, {obj_id:2128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184816}, {obj_id:2129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200736}, {obj_id:2130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224430}, {obj_id:2132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207161}, {obj_id:2133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192675}, {obj_id:2135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385804}, {obj_id:2137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230239}, {obj_id:2153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202184}, {obj_id:2156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205408}, {obj_id:2157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206436}, {obj_id:2158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174583}, {obj_id:2162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213869}, {obj_id:2163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195408}, {obj_id:2164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203912}, {obj_id:2166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182577}, {obj_id:2167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181498}, {obj_id:2168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199791}, {obj_id:2169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184951}, {obj_id:2170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265434}, {obj_id:2171, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186761}, {obj_id:2172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180107}, {obj_id:2173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205227}, {obj_id:2174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210318}, {obj_id:2175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196533}, {obj_id:2176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180448}, {obj_id:2177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185110}, {obj_id:2178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191697}, {obj_id:2179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217620}, {obj_id:2180, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221861}, {obj_id:2181, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185962}, {obj_id:2182, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:422104}, {obj_id:2183, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190931}, {obj_id:2184, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192945}, {obj_id:2185, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179350}, {obj_id:2186, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:2187, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188846}, {obj_id:2188, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417908}, {obj_id:2189, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180199}, {obj_id:2195, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207911}, {obj_id:2203, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188121}, {obj_id:2204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196915}, {obj_id:2205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385249}, {obj_id:2209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2211, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem [2024-06-24 16:58:51.559045] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=1896] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:51.562609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.586997] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.591548] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D432-0-0] [lt=27] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.591717] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D434-0-0] [lt=22] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.592123] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:51.592252] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=128] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:51.592314] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [1572][T1003_ReplayPro][T1003][Y0-0000000000000000-0-0] [lt=15] dump tenant replay process(tenant_id=1003, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:51.594495] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] [COMPACTION DAG STATUS] (start_time=1719219521592447, end_time=1719219531594491, dag_status={}) [2024-06-24 16:58:51.594532] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594555] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594588] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594603] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594641] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219531594629000, start_id=1719219531594629000, end_id=1719219531594629001) [2024-06-24 16:58:51.594656] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594671] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594686] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:51.594700] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594720] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594757] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594773] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594789] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594838] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594854] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594870] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594889] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594907] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594923] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594939] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594955] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594971] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.594987] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595001] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595017] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595043] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595076] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595094] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595110] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595126] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595142] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595209] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595225] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595241] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595274] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595292] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595308] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595340] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595356] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595372] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595388] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595404] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595435] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595451] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595467] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595483] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595499] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595515] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595531] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595547] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595565] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595583] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595641] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595658] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:51.595675] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:51.595689] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:51.595703] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:51.595717] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:51.595726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:51.595738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:51.595750] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:51.595758] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:51.595769] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:51.595779] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:51.595792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [163794][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:51.615016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:51.615066] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1719219531416524000, v:0}, base_version={val:1719219531216126002, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219531416524000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219531615052, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:51.617139] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219531616831000, start_id=1719219531616831000, end_id=1719219531616831001) [2024-06-24 16:58:51.617724] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:51.621768] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:51.621863] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=14] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:51.623726] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163135][T1_L0_G0][T1][YB42AC141156-00061B9D9E60C11F-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103427715087, cache_obj->added_lc()=false, cache_obj->get_object_id()=9376, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:51.637481] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [967][T1001_ArcSender][T1001][YB42AC141156-00061B9D8DB0C0E5-0-0] [lt=37][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:51.658565] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769B2-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.661381] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A893A-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.662637] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.664038] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:146) [1616][T1003_Compactio][T1003][YB42AC141156-00061B9D99D0C1C6-0-0] [lt=32] InfoPoolResizeTask(cost_ts=16) [2024-06-24 16:58:51.666376] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A893F-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.669127] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8941-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.669793] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219531669659000, start_id=1719219531669659000, end_id=1719219531669659001) [2024-06-24 16:58:51.671778] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8943-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4801, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.672515] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1719219531672512, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-06-24 16:58:51.675354] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=37] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=466, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:51.675352] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=35] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:51.675388] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:51.675431] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:51.675456] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=555, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:51.675473] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=24, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:51.676565] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=17] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13760, offset=3456434}, end_cursor:ObLogCursor{file_id=1, log_id=13761, offset=3456707}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d4c050, len:590, log_data_len:273, seq:13760, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:51.679368] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91A-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219531679177000, start_id=1719219531679177000, end_id=1719219531679177001) [2024-06-24 16:58:51.679449] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91A-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=9514, avg_group_log_size=528) [2024-06-24 16:58:51.679474] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91A-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8980) [2024-06-24 16:58:51.679851] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9514) [2024-06-24 16:58:51.679891] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=5] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9514) [2024-06-24 16:58:51.679911] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=18, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=393, avg_log_submit_to_slide_time=401) [2024-06-24 16:58:51.680500] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=30] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13761, offset=3456707}, end_cursor:ObLogCursor{file_id=1, log_id=13762, offset=3456972}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d50050, len:4413, log_data_len:265, seq:13761, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:51.681666] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:51.681703] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:51.687055] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.696388] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8965-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.699101] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8967-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:51.700769] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:51.703789] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1353][T1004_LockWaitM][T1004][Y0-0000000000000000-0-0] [lt=17] report RowHolderMapper summary info(count=2620, bkt_cnt=7838) [2024-06-24 16:58:51.704094] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F2-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:51.707043] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:51.707154] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:51.707360] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:51.707426] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:51.707592] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:51.707680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:51.707784] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10769F5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:51.718995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283368845312, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:51.719806] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8993-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.723411] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2024-06-24 16:58:51.723443] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:51.723476] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=21] cannot_recycle_log_size statistics(cannot_recycle_log_size=103085398, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:51.730611] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2024-06-24 16:58:51.731239] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=17] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:51.731292] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219531730879000, start_id=1719219531730879000, end_id=1719219531730879001) [2024-06-24 16:58:51.731380] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3404, avg_group_log_size=378) [2024-06-24 16:58:51.731407] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3404) [2024-06-24 16:58:51.731767] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=366, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:51.731804] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=17, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:51.732620] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D448-0-0] [lt=32] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:51.751463] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [1569][T1003_DupTbLeas][T1003][Y0-0000000000000000-0-0] [lt=12][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2024-06-24 16:58:51.751540] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [1569][T1003_DupTbLeas][T1003][Y0-0000000000000000-0-0] [lt=24][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1003 and flag like "%DUPLICATE%", tenant_id=1003, exec_tenant_id=1, need_member_list=false) [2024-06-24 16:58:51.754008] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [1580][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=16][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1003, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:51.754109] WDIAG read_multi_row (ob_table_access_helper.h:238) [1580][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=34][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1003, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:51.754685] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=15] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:51.755529] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=31] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:51.756456] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:51.756563] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526812609000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:51.757195] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219531756215000, start_id=1719219531756215000, end_id=1719219531756215001) [2024-06-24 16:58:51.759811] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A89C6-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:51.762653] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.762778] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A89C9-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.763644] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=44920, mem_used=164299776) [2024-06-24 16:58:51.766909] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E8210B-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219531766786000, start_id=1719219531766786000, end_id=1719219531766786001) [2024-06-24 16:58:51.767943] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A89D4-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219531767843000, start_id=1719219531767843000, end_id=1719219531767843001) [2024-06-24 16:58:51.769226] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076A47-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219531768901000, start_id=1719219531768901000, end_id=1719219531768901001) [2024-06-24 16:58:51.769311] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042AB6-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219531768901000, start_id=1719219531768901001, end_id=1719219531768901002) [2024-06-24 16:58:51.769685] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A354-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219531768901000, start_id=1719219531768901002, end_id=1719219531768901003) [2024-06-24 16:58:51.775411] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:51.775427] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:51.775463] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=506, avg_log_submit_to_slide_time=516) [2024-06-24 16:58:51.782132] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=383, avg_log_submit_to_slide_time=392) [2024-06-24 16:58:51.783648] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:51.785464] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=30] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:51.785560] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=27] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219527132319000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:51.787114] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.794696] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219531794257000, start_id=1719219531794257000, end_id=1719219531794257001) [2024-06-24 16:58:51.794763] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:51.794792] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:51.795160] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=368, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:51.795190] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=16, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:51.795202] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=4, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:51.795217] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=428, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:51.795223] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=20, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:51.804973] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] new mysql sessid created(conn.sessid_=3221494483, support_ssl=false) [2024-06-24 16:58:51.805052] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] sm conn init succ(conn.sessid_=3221494483, sess.client_addr_="172.20.17.86:49536") [2024-06-24 16:58:51.805071] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=14] accept one succ(*s={this:0x7f47833c2030, session_id:3221494483, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:51.805148] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=27][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494483, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:51.805174] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] kill and revert session(conn.sessid_=3221494483, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:51.805187] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=12] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494483, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:51.805206] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] mark session id unused(conn.sessid_=3221494483) [2024-06-24 16:58:51.805220] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494483, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:51.815105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:51.817125] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219531816449000, start_id=1719219531816449000, end_id=1719219531816449001) [2024-06-24 16:58:51.817434] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076A6B-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:51.823490] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:51.823526] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=23] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1236) [2024-06-24 16:58:51.827590] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=17] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=43, mem_used=49913856) [2024-06-24 16:58:51.827668] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=27] release old cannot free more memory [2024-06-24 16:58:51.827687] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=98, size_used=0, mem_used=49913856) [2024-06-24 16:58:51.835559] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [1558][T1003_TntShared][T1003][Y0-0000000000000000-0-0] [lt=21] dump dtl interm result cost(us)(dump_cost=5, ret=0, interm count=0, dump count=618) [2024-06-24 16:58:51.835593] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [1558][T1003_TntShared][T1003][Y0-0000000000000000-0-0] [lt=28] clear dtl interm result cost(us)(clear_cost=4, ret=0, gc_.expire_keys_.count()=0, dump count=618, interm count=0, clean count=0) [2024-06-24 16:58:51.862710] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:51.862740] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:51.862757] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.868803] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219531868136000, start_id=1719219531868136000, end_id=1719219531868136001) [2024-06-24 16:58:51.869910] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219531869191000, start_id=1719219531869191000, end_id=1719219531869191001) [2024-06-24 16:58:51.873399] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873710] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873710] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873715] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873845] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873909] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.873913] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874151] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8A80-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219531873415000, start_id=1719219531873415000, end_id=1719219531873415001) [2024-06-24 16:58:51.874169] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874186] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874184] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874245] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8A80-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=19, avg_log_batch_cnt=1, total_group_log_size=8981, avg_group_log_size=472) [2024-06-24 16:58:51.874266] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874276] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874274] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8A80-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8564) [2024-06-24 16:58:51.874361] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874527] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874596] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8981) [2024-06-24 16:58:51.874640] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874660] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874662] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874661] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=8981) [2024-06-24 16:58:51.874708] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=19, avg_log_gen_to_freeze_time=39, avg_log_gen_to_submit_time=48, avg_log_submit_to_flush_time=399, avg_log_submit_to_slide_time=410) [2024-06-24 16:58:51.874724] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.874836] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:51.887172] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.912327] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:51.919504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283370942464, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:51.931267] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219531930426000, start_id=1719219531930426000, end_id=1719219531930426001) [2024-06-24 16:58:51.940532] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:262) [1663][T1004_ArcSender][T1004][YB42AC141156-00061B9D95C0C0E5-0-0] [lt=38] ObArchiveSender is running(thread_index=4) [2024-06-24 16:58:51.957253] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219531956798000, start_id=1719219531956798000, end_id=1719219531956798001) [2024-06-24 16:58:51.962768] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.965024] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [653][T1002_L0_G0][T1002][YB42AC141156-00061B9DA0E82112-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.967063] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076B80-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.970192] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076B84-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:51.972963] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8B0D-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:51.975036] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:51.975073] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:51.975098] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:51.975118] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:51.975149] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:51.975457] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=464, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:51.975732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8B0F-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:51.987231] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:51.995174] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1719219531994803000, start_id=1719219531994803000, end_id=1719219531994803001) [2024-06-24 16:58:51.997016] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8B25-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:51.999770] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8B27-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.003032] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BCC-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.003656] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=136] gc stale ls task succ [2024-06-24 16:58:52.005499] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:52.005547] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:52.005629] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:52.005657] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:52.005712] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:52.005744] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:52.005785] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BD0-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:52.014476] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:787) [163649][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=40] ps cache evict(tenant_id=1, stmt_id_map_.size()=12, stmt_info_map_.size()=12, op.get_used_size()=26439, get_mem_high()=410706180, expired_stmt_ids.count()=0, closed_stmt_ids.count()=12) [2024-06-24 16:58:52.014619] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:196) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=26] skip repeat study(ret=0, this={this:0x7f47032d41f0, last_study_timestamp:1719219472017305, last_refresh_timestamp:1719219472019582, last_reclaim_timestamp:1719219472021657, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219471621660000, v:0}, is_inited:true}, current_timestamp=1719219532014615, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2024-06-24 16:58:52.015189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:52.016878] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1633][T1003_Occam][T1003][YB42AC141156-00061B9D9B00C161-0-0] [lt=65][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1858, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:52.016926] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076BDB-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.016945] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=31] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1003 , snapshot_version=1719219472010141000, snapshot_type=1, create_time=1719219472011679, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.016987] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=28] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1003 , snapshot_version=1719219471621660000, snapshot_type=2, create_time=1719219472011679, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.017013] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=18] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1003 , snapshot_version=1719219471959630000, snapshot_type=3, create_time=1719219472011679, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.017039] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=19] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1003 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1719219472011679, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.017293] INFO [STORAGE.TRANS] get_tx_ctx_ (ob_trans_ctx_mgr_v4.cpp:588) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] transaction statistics(ls_id={id:1}, total_tx_ctx_count=1) [2024-06-24 16:58:52.017297] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:618) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=16] succeed to update global reserved snapshot(ret=0, this={this:0x7f47032d41f0, last_study_timestamp:1719219472017305, last_refresh_timestamp:1719219472019582, last_reclaim_timestamp:1719219472021657, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219471621660000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1719219471621660000, v:0}, reserved_snapshot={val:1719219471621660000, v:0}) [2024-06-24 16:58:52.017333] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219532016999000, start_id=1719219532016999000, end_id=1719219532016999001) [2024-06-24 16:58:52.017331] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:552) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=32] multi-version garbage collector refresh successfully(this={this:0x7f47032d41f0, last_study_timestamp:1719219472017305, last_refresh_timestamp:1719219472019582, last_reclaim_timestamp:1719219472021657, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219471621660000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1719219471621660000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1719219472011679, reserved_addr:"172.20.17.86:2882", is_this_server_disabled:false, status:0}) [2024-06-24 16:58:52.017362] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:231) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=30] repeat refresh successfully(ret=0, this={this:0x7f47032d41f0, last_study_timestamp:1719219472017305, last_refresh_timestamp:1719219532017361, last_reclaim_timestamp:1719219472021657, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219471621660000, v:0}, is_inited:true}, current_timestamp=1719219532014685, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2024-06-24 16:58:52.017386] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:266) [1633][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=23] skip repeat reclaim(ret=0, this={this:0x7f47032d41f0, last_study_timestamp:1719219472017305, last_refresh_timestamp:1719219532017361, last_reclaim_timestamp:1719219472021657, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219471621660000, v:0}, is_inited:true}, current_timestamp=1719219532017386, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2024-06-24 16:58:52.036566] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1453][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=45] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:52.038465] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16513, offset=3763179}, end_cursor:ObLogCursor{file_id=1, log_id=16514, offset=3763452}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d54050, len:1045, log_data_len:273, seq:16513, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:52.042488] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90B-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219532042370000, start_id=1719219532042370000, end_id=1719219532042370001) [2024-06-24 16:58:52.042579] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90B-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7763, avg_group_log_size=646) [2024-06-24 16:58:52.042610] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90B-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7763) [2024-06-24 16:58:52.042857] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1719219532042854, bytes: 171042642, bw: 0.018589 MB/s, add_ts: 1007614, add_bytes: 19640 [2024-06-24 16:58:52.042922] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7763) [2024-06-24 16:58:52.042964] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=9] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7763) [2024-06-24 16:58:52.042981] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=394, avg_log_submit_to_slide_time=400) [2024-06-24 16:58:52.043498] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=22] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16514, offset=3763452}, end_cursor:ObLogCursor{file_id=1, log_id=16515, offset=3763717}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d58050, len:772, log_data_len:265, seq:16514, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:52.046309] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=9] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1004) [2024-06-24 16:58:52.046340] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=26] start lib cache evict(tenant_id=1004, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:52.046359] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1004, cache_evict_num=0, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:52.046377] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:52.049906] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8B76-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.052565] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8B79-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.052937] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=497, alloc_obj_list=[{obj_id:35, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:39, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:40, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184250}, {obj_id:41, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:43, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:45, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:53, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175298}, {obj_id:84, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174332}, {obj_id:145, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:146, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:147, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:148, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:151, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:152, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:153, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:154, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:155, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:156, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:157, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:158, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:159, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:160, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198897}, {obj_id:161, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:162, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:163, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:164, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:165, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:166, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:167, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:168, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:169, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:170, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:171, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:172, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:173, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:174, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:175, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:176, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:177, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175451}, {obj_id:178, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181217}, {obj_id:179, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:180, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:181, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:182, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235894}, {obj_id:183, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209782}, {obj_id:184, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230576}, {obj_id:185, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:186, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:187, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:188, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:189, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:190, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:191, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:192, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:193, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:195, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:196, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:197, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:198, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:199, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:200, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:201, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:202, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:203, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:204, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:205, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:206, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:207, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:208, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:209, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:210, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:211, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:212, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:213, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:214, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:215, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:216, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299219}, {obj_id:217, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236649}, {obj_id:218, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:219, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184514}, {obj_id:220, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:221, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:222, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:223, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180301}, {obj_id:224, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:225, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:226, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:227, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:228, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183169}, {obj_id:229, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:230, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:232, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:235, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:236, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:237, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:238, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:239, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:240, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:241, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:242, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188148}, {obj_id:243, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:244, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:245, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:246, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:247, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:248, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:249, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:250, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:251, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:252, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:253, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:254, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:255, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206580}, {obj_id:256, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208496}, {obj_id:257, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:258, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308540}, {obj_id:260, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207652}, {obj_id:261, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:262, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172752}, {obj_id:263, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:264, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:265, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:266, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:267, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:268, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:269, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:270, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:271, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:272, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157105}, {obj_id:273, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175095}, {obj_id:274, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176760}, {obj_id:275, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185989}, {obj_id:276, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:277, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:278, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:279, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419083}, {obj_id:280, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417152}, {obj_id:283, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239831}, {obj_id:284, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242976}, {obj_id:285, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256105}, {obj_id:286, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256298}, {obj_id:287, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:288, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:289, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:290, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:291, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:292, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:293, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:294, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231047}, {obj_id:295, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:296, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:297, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:298, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:299, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215340}, {obj_id:300, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:301, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:302, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:303, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:304, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:307, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:308, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:311, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:375291}, {obj_id:312, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:384468}, {obj_id:313, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325700}, {obj_id:314, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:334948}, {obj_id:315, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227240}, {obj_id:316, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268192}, {obj_id:317, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200156}, {obj_id:318, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206516}, {obj_id:335, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182820}, {obj_id:349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191406}, {obj_id:352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:362, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204485}, {obj_id:363, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224055}, {obj_id:366, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185366}, {obj_id:367, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195268}, {obj_id:368, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:375, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:376, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:379, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:380, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234934}, {obj_id:381, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:382, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:383, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:384, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218544}, {obj_id:385, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:386, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:387, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:388, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:391, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189184}, {obj_id:392, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201018}, {obj_id:395, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191754}, {obj_id:396, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204870}, {obj_id:399, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:400, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:403, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:404, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:407, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:408, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199110}, {obj_id:411, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:412, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:425, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:426, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:427, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:428, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:429, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:430, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217209}, {obj_id:431, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:432, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:433, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:434, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:437, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201929}, {obj_id:438, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220211}, {obj_id:441, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186646}, {obj_id:442, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197186}, {obj_id:449, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187051}, {obj_id:450, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236235}, {obj_id:451, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291681}, {obj_id:452, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229118}, {obj_id:453, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200168}, {obj_id:454, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219871}, {obj_id:455, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201375}, {obj_id:456, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291677}, {obj_id:457, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181926}, {obj_id:458, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201455}, {obj_id:461, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198111}, {obj_id:462, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214476}, {obj_id:473, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212131}, {obj_id:474, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235568}, {obj_id:489, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203200}, {obj_id:490, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222135}, {obj_id:493, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:494, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:497, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252923}, {obj_id:498, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296972}, {obj_id:509, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:510, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237536}, {obj_id:511, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292049}, {obj_id:512, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229486}, {obj_id:513, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200544}, {obj_id:514, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221206}, {obj_id:515, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201791}, {obj_id:516, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292045}, {obj_id:517, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182278}, {obj_id:518, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201839}, {obj_id:521, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263105}, {obj_id:522, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312324}, {obj_id:527, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269484}, {obj_id:528, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321943}, {obj_id:537, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254176}, {obj_id:538, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:298902}, {obj_id:551, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251638}, {obj_id:552, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295058}, {obj_id:555, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223603}, {obj_id:556, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252824}, {obj_id:573, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190308}, {obj_id:574, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238837}, {obj_id:575, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292385}, {obj_id:576, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229822}, {obj_id:577, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200872}, {obj_id:578, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222549}, {obj_id:579, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202111}, {obj_id:580, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292381}, {obj_id:581, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182630}, {obj_id:582, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202159}, {obj_id:587, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:588, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:611, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205738}, {obj_id:612, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225979}, {obj_id:625, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274568}, {obj_id:626, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329621}, {obj_id:643, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:644, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:645, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206454}, {obj_id:646, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:647, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:648, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:649, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197356}, {obj_id:650, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178512}, {obj_id:651, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198928}, {obj_id:652, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199105}, {obj_id:653, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156378}, {obj_id:654, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157162}, {obj_id:655, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176121}, {obj_id:656, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:657, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:307685}, {obj_id:658, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:660, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312830}, {obj_id:661, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:662, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:663, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:664, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202402}, {obj_id:665, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:666, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216429}, {obj_id:667, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:668, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157107}, {obj_id:669, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176570}, {obj_id:670, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176412}, {obj_id:672, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:673, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156195}, {obj_id:674, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:676, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:677, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372653}, {obj_id:678, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:679, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:680, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255326}, {obj_id:681, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255084}, {obj_id:682, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281876}, {obj_id:683, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319873}, {obj_id:684, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209231}, {obj_id:700, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192790}, {obj_id:701, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257630}, {obj_id:702, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234000}, {obj_id:731, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200128}, {obj_id:733, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:409897}, {obj_id:734, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:400862}, {obj_id:736, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175113}, {obj_id:737, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184566}, {obj_id:742, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175296}, {obj_id:743, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181792}, {obj_id:746, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185582}, {obj_id:747, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:797, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200312}, {obj_id:798, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198098}, {obj_id:799, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288253}, {obj_id:800, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:801, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200393}, {obj_id:802, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213250}, {obj_id:803, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328028}, {obj_id:804, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198852}, {obj_id:805, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:806, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:807, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:808, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:809, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174410}, {obj_id:815, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173948}, {obj_id:825, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185181}, {obj_id:828, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238944}, {obj_id:832, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:833, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:834, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:835, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:836, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188748}, {obj_id:837, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207583}, {obj_id:838, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220441}, {obj_id:839, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189684}, {obj_id:840, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183154}, {obj_id:841, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246969}, {obj_id:842, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249608}, {obj_id:843, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231450}, {obj_id:844, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180118}, {obj_id:845, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268752}, {obj_id:846, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270542}, {obj_id:847, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270227}, {obj_id:848, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273208}, {obj_id:849, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257627}, {obj_id:850, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273232}, {obj_id:851, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254489}, {obj_id:852, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269717}, {obj_id:853, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175231}, {obj_id:854, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181662}, {obj_id:855, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177134}, {obj_id:861, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177715}, {obj_id:869, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187847}, {obj_id:879, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200764}, {obj_id:880, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200755}, {obj_id:930, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:466821}, {obj_id:931, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:932, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296709}, {obj_id:933, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318958}, {obj_id:934, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312747}, {obj_id:935, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325200}, {obj_id:936, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217553}, {obj_id:937, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281577}, {obj_id:938, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189394}, {obj_id:939, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:641561}, {obj_id:940, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:244732}, {obj_id:941, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232660}, {obj_id:942, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:943, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:944, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217413}, {obj_id:945, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189522}, {obj_id:946, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232546}, {obj_id:1073, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246494}, {obj_id:1140, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:378647}, {obj_id:1141, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306509}, {obj_id:1142, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1143, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:1144, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198777}, {obj_id:1194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247404}, {obj_id:1320, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:438066}, {obj_id:1321, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260903}, {obj_id:1322, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206816}, {obj_id:1323, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193061}, {obj_id:1324, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178317}, {obj_id:1325, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182140}, {obj_id:1326, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174724}, {obj_id:1327, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195853}, {obj_id:1328, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184944}, {obj_id:1329, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201089}, {obj_id:1330, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209476}, {obj_id:1331, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:170609}, {obj_id:1332, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171169}, {obj_id:1333, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203806}, {obj_id:1334, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200651}, {obj_id:1336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195256}, {obj_id:1337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203334}, {obj_id:1338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198057}, {obj_id:1339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192160}, {obj_id:1340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194971}, {obj_id:1341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196164}, {obj_id:1342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198958}, {obj_id:1343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197940}, {obj_id:1344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200683}, {obj_id:1345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197036}, {obj_id:1346, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199801}, {obj_id:1347, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204590}, {obj_id:1348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197459}, {obj_id:1349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207323}, {obj_id:1350, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200262}, {obj_id:1351, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197164}, {obj_id:1353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199224}, {obj_id:1354, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201933}, {obj_id:1355, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202018}, {obj_id:1356, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206006}, {obj_id:1357, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204664}, {obj_id:1358, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205068}, {obj_id:1359, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208689}, {obj_id:1360, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207750}, {obj_id:1361, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209040}, {obj_id:13 [2024-06-24 16:58:52.054671] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=1729] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:52.056293] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=22] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:52.058195] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [162957][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=19] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f4841ffc2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:52.062825] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.064764] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 383.00) [2024-06-24 16:58:52.064798] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:52.064898] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 353.00) [2024-06-24 16:58:52.064915] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:52.064948] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.064970] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.064990] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065031] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065045] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065059] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065086] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065102] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065116] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065130] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065156] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.065170] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:52.070008] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219532069857000, start_id=1719219532069857000, end_id=1719219532069857001) [2024-06-24 16:58:52.079798] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:52.079827] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=21] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:52.079847] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1235) [2024-06-24 16:58:52.087287] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.096099] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8BAF-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.096115] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.096634] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=7] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.096642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.096825] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.096827] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.096949] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.096955] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097103] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097102] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097129] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097136] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097168] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097178] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097259] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097280] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097358] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097358] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097429] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097432] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=8] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097482] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097476] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097486] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097663] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097708] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097739] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097740] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097868] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097871] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.097954] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098049] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=65] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1229, mem_used=4159488) [2024-06-24 16:58:52.098141] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098142] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098241] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098608] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098615] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098662] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=6] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098671] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098682] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098685] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098688] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098699] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098707] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098700] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098715] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098753] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098788] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098889] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.098933] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.112533] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:52.112556] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:52.112581] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=13] cannot_recycle_log_size statistics(cannot_recycle_log_size=73654922, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:52.116153] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163019][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD25-0-0] [lt=35] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:52.116170] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163019][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD25-0-0] [lt=12] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=23) [2024-06-24 16:58:52.120016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283370942464, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:52.125276] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=16] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:52.131408] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] submit log success(service_type_=0, last_id=1719219548711542000, limited_id=1719219548711542000) [2024-06-24 16:58:52.131436] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] submit log with lock success(service_type_=0, last_id=1719219548711542000, limited_id=1719219548711542000) [2024-06-24 16:58:52.131454] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219532131098000, start_id=1719219532131098000, end_id=1719219532131098001) [2024-06-24 16:58:52.132237] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=440, avg_log_submit_to_slide_time=447) [2024-06-24 16:58:52.132259] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1719219548711542000, latest_scn={val:1719219532131098001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219548711542000, latest_log_ts:{val:1719219532131098001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:52.132324] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=64] handle submit callback(service_type_=0, success=true, used_ts=917, log_ts={val:1719219532131098001, v:0}, limited_id=1719219548711542000) [2024-06-24 16:58:52.132340] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=15] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:52.132354] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=13] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:52.135047] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219532134270000, start_id=1719219532134270000, end_id=1719219532134270001) [2024-06-24 16:58:52.135318] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=14] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:52.139092] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=19] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:52.154218] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:52.154386] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B8-0-0] [lt=20] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:52.154518] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B8-0-0] [lt=125] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:52.156689] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=26] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:52.157383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219532156367000, start_id=1719219532156367000, end_id=1719219532156367001) [2024-06-24 16:58:52.162882] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.175221] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:52.175580] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:52.175603] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:52.175643] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=510, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:52.175669] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=25, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:52.175690] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:52.175717] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=513, avg_log_submit_to_slide_time=522) [2024-06-24 16:58:52.176489] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=31] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:52.176659] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E8-0-0] [lt=57] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:52.176694] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E8-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:52.176720] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D903-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:52.176740] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D903-0-0] [lt=18] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:52.187386] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:52.187412] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:52.187431] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.195271] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219532194243000, start_id=1719219532194243000, end_id=1719219532194243001) [2024-06-24 16:58:52.199455] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:52.199652] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B8-0-0] [lt=21] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219529865529001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:52.200043] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B8-0-0] [lt=127] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219531869191003, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219529865529001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:52.200152] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B8-0-0] [lt=105] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:52.202324] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:52.215280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:52.217241] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [958][T1001_TenantWea][T1001][YB42AC141156-00061B9D8D713917-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.582436513900756836e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=379, Throttle Trigger(MB)=227, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.487444700088913123e+02) [2024-06-24 16:58:52.217296] INFO [STORAGE.TRANS] create_tx_ctx_ (ob_trans_ctx_mgr_v4.cpp:511) [958][T1001_TenantWea][T1001][YB42AC141156-00061B9D8D713917-0-0] [lt=49] transaction statistics(ls_id={id:1}, total_count=1) [2024-06-24 16:58:52.217468] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219532217396000, start_id=1719219532217396000, end_id=1719219532217396001) [2024-06-24 16:58:52.245768] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042BAD-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:52.247222] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:52.247259] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:52.247687] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:52.247701] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=777, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:52.247708] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:52.248602] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8C71-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:52.253856] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8C75-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.256757] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8C77-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.259568] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8C79-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4801, pos=2781, bitmap=NULL) [2024-06-24 16:58:52.262940] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.270152] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219532269110000, start_id=1719219532269110000, end_id=1719219532269110001) [2024-06-24 16:58:52.282360] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:52.282410] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA107682D-0-0] [lt=21] [APPLY STAT CB APPEND COST TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=20, this=0x7f473495c280, extra_info="") [2024-06-24 16:58:52.282439] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA107682D-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=399, this=0x7f473495c4b0, extra_info="") [2024-06-24 16:58:52.282454] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA107682D-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=0, this=0x7f473495c6e0, extra_info="") [2024-06-24 16:58:52.282467] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA107682D-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=-482, this=0x7f473495c910, extra_info="") [2024-06-24 16:58:52.282480] INFO [LIB] stat (utility.h:1165) [163816][T1002_ApplySrv0][T1002][YB42AC141156-00061B9DA107682D-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=16, stat_interval=5000000, avg (count/cost)=-62, this=0x7f473495cb40, extra_info="") [2024-06-24 16:58:52.283898] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:52.283925] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=26] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:52.283925] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E4-0-0] [lt=22] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:52.283968] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162256][SerScheQueue1][T0][YB42AC141156-00061B9D8A70C6E4-0-0] [lt=37] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:52.284269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076D8B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:52.287404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.287538] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042BCB-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.291692] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CA6-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.294313] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:52.294413] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:52.294584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:52.294652] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:52.294795] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:52.294865] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:52.294898] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=528437248, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=545304576, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:52.294959] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CAB-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:52.295043] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=57] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:52.295074] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:52.295151] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=375809638, max_wa_memory_size=375809638, tmp_max_wa_memory_size=375809638, pre_mem_target=373712486, remain_memory_size=375809638, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1665294336, washable_size=-2, max_workarea_memory_size=375809638, max_tenant_memory_size=5850898432, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:52.295265] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46976204, calc_global_bound_size=1048576000000, mem_target_=375809638, wa_max_memory_size=375809638, profile_cnt_=0, total_memory_size=0, max_wa_size=375809638, avg_bound_size=46976204, max_bound_size=46976204, min_bound_size_=1048576) [2024-06-24 16:58:52.295286] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, global_bound_size_=46976204, manual_calc_cnt_=417240, drift_size_=0, pre_drift_size=28503408, wa_max_memory_size=375809638, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=46976204, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=375809638, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:52.295351] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:52.295435] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:52.295454] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=18] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:52.295528] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=24] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:52.295677] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:52.295697] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:52.305105] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8CBD-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.320327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283364651008, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:52.327604] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112502, mem_used=264127488) [2024-06-24 16:58:52.331610] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219532331496000, start_id=1719219532331496000, end_id=1719219532331496001) [2024-06-24 16:58:52.342972] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076DDA-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.344444] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:52.345198] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=22] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:52.345351] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=152] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:52.345414] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [162938][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=19] dump tenant replay process(tenant_id=1, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:52.345765] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076DDB-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.357462] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219532356809000, start_id=1719219532356809000, end_id=1719219532356809001) [2024-06-24 16:58:52.362998] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.369609] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219532369490000, start_id=1719219532369490000, end_id=1719219532369490001) [2024-06-24 16:58:52.369667] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:52.370093] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=18] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=377, get_gts_with_stc_cnt=1, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=1, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:52.372306] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [162947][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:52.372420] WDIAG read_multi_row (ob_table_access_helper.h:238) [162947][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=39][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:52.375329] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:52.375364] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:52.375529] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=33] success to update min reserved snapshot(reserved_snapshot=1719217726709080000, duration=1800, snapshot_gc_ts=1719219526709080000) [2024-06-24 16:58:52.375761] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=15, stat_interval=5000000, avg (count/cost)=53, this=0x7f46d7ab8280, extra_info="") [2024-06-24 16:58:52.375788] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=25] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=15, stat_interval=5000000, avg (count/cost)=419, this=0x7f46d7ab84b0, extra_info="") [2024-06-24 16:58:52.375800] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=12] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=15, stat_interval=5000000, avg (count/cost)=0, this=0x7f46d7ab86e0, extra_info="") [2024-06-24 16:58:52.375811] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=10] [APPLY STAT CB EXECUTE TIME](cur_stat_count=15, stat_interval=5000000, avg (count/cost)=-603, this=0x7f46d7ab8910, extra_info="") [2024-06-24 16:58:52.375825] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=15, stat_interval=5000000, avg (count/cost)=-131, this=0x7f46d7ab8b40, extra_info="") [2024-06-24 16:58:52.376087] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=27] update reserved snapshot finished(cost_ts=562, reserved_snapshot=1719217726709080000) [2024-06-24 16:58:52.377168] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1719219522375152, end_time=1719219532377164, dag_status={}) [2024-06-24 16:58:52.377199] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377217] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377262] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377279] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377293] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377321] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:52.377332] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377369] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377403] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377422] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377453] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377470] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377486] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377502] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377518] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377534] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377553] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377582] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377598] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377611] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377640] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377654] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377670] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377689] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377705] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377721] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377737] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377753] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377769] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377785] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377816] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377834] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377867] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377883] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377899] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377915] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377931] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377965] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377981] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.377997] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378013] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378050] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378066] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378080] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378097] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378113] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378129] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378208] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378224] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:52.378291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:52.378305] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:52.378319] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:52.378331] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:52.378342] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:52.378352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:52.378363] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:52.378376] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:52.378385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:52.378396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:52.378407] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:52.382061] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:52.382092] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:52.382486] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=392, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:52.382518] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:52.382549] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:52.382573] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=455, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:52.382591] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=25, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:52.387463] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.395368] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219532394859000, start_id=1719219532394859000, end_id=1719219532394859001) [2024-06-24 16:58:52.396620] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8D2D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.399943] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [162964][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=26] XA scheduler heartbeat task statistics(avg_time=3) [2024-06-24 16:58:52.415377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:52.417470] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219532417061000, start_id=1719219532417061000, end_id=1719219532417061001) [2024-06-24 16:58:52.422189] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=129951, mem_used=326519808) [2024-06-24 16:58:52.429948] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B4-0-0] [lt=45][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:52.429983] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B4-0-0] [lt=33][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:52.463056] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.468728] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:52.470332] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219532469822000, start_id=1719219532469822000, end_id=1719219532469822001) [2024-06-24 16:58:52.470407] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:52.470442] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:52.470795] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=339, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:52.470820] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:52.470832] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=3, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:52.470845] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=386, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:52.470854] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=8] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:52.482143] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:52.482180] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:52.482438] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:52.482522] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=379, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:52.482556] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:52.482574] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:52.482603] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=487, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:52.482631] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=26, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:52.484167] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] Garbage Collector is running(seq_=629, gc_interval=10000000) [2024-06-24 16:58:52.484233] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=28] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:52.484265] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] gc_check_member_list_ cost time(ret=0, time_us=68) [2024-06-24 16:58:52.484284] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:52.484301] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:52.484322] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:52.484338] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=15] execute_gc cost time(ret=0, time_us=18) [2024-06-24 16:58:52.484351] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [162944][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:52.484884] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:52.484931] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=34] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1256) [2024-06-24 16:58:52.487521] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.506941] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [1614][T1003_MediumLoo][T1003][YB42AC141156-00061B9D98E0C24C-0-0] [lt=24] MediumCheckTask(cost_ts=34) [2024-06-24 16:58:52.520695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283362553856, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:52.529652] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=62] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1719219532331496000, v:0}, base_version={val:1719219532131098002, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219532331496000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219532529635, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:52.530194] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1387][T1004_ArcSender][T1004][YB42AC141156-00061B9D9370C0E5-0-0] [lt=21][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:52.531744] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219532531362000, start_id=1719219532531362000, end_id=1719219532531362001) [2024-06-24 16:58:52.532229] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3539) [2024-06-24 16:58:52.532271] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=5] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3539) [2024-06-24 16:58:52.532397] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219532331496000, v:0}, new_max_version={val:1719219532331496000, v:0}, last_min_version={val:1719219532131098002, v:0}, last_max_version={val:1719219532131098002, v:0}, total_time_us=2699, delta_us=200900) [2024-06-24 16:58:52.532428] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1719219532331496000, v:0}, min_version={val:1719219532331496000, v:0}, max_version={val:1719219532331496000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:52.555154] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=31] success to update min reserved snapshot(reserved_snapshot=1719217726749170000, duration=1800, snapshot_gc_ts=1719219526749170000) [2024-06-24 16:58:52.555706] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=23] update reserved snapshot finished(cost_ts=555, reserved_snapshot=1719217726749170000) [2024-06-24 16:58:52.557569] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219532556701000, start_id=1719219532556701000, end_id=1719219532556701001) [2024-06-24 16:58:52.557830] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=24] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:52.561459] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042CAA-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:52.563116] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.564750] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042CAB-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:52.570331] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8DFE-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.573110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076EF8-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.576166] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8E04-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:52.582652] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:52.587579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.595354] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219532594712000, start_id=1719219532594712000, end_id=1719219532594712001) [2024-06-24 16:58:52.601349] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8E28-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:52.604648] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042CC6-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.609239] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042CC8-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.612043] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:52.612140] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:52.612313] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:52.612368] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:52.612514] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:52.612579] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:52.612645] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:52.612680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F2A-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:52.615469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:52.615743] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=59] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:52.617607] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219532616885000, start_id=1719219532616885000, end_id=1719219532616885001) [2024-06-24 16:58:52.621828] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=17] gc stale ls task succ [2024-06-24 16:58:52.621965] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=14] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:52.622397] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1076F34-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.626165] WDIAG [OCCAM] runTimerTask (ob_occam_timer.h:163) [1401][T1004_MultiVers][T1004][Y0-0000000000000000-0-0] [lt=134][errcode=0] task scheduled too delay(scheduled_delay=1387025, expected_run_ts_us_=1719219531239133, ObClockGenerator::getRealClock()=1719219532626161, ret=0, ret="OB_SUCCESS", *this={this:0x7f4756ffcb30, caller:ob_multi_version_garbage_collector.cpp:start:115, function_type:ZN9oceanbase19concurrency_control30ObMultiVersionGarbageCollector5startEvE5$_960, timer_running_flag:1, total_running_count:1, func_shared_ptr_.ptr:0x7f4756ffcd90, time_wheel:0x7f473f9c7890, thread_pool:0x7f473f9c70f0, is_running:1, time_interval:60.00s, expected_run_time:16:58:51.239, task_priority:1, with_handle_protected:1}) [2024-06-24 16:58:52.626338] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:196) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=21] skip repeat study(ret=0, this={this:0x7f4721f061f0, last_study_timestamp:1719219412625565, last_refresh_timestamp:1719219472625320, last_reclaim_timestamp:1719219412630009, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219412155330000, v:0}, is_inited:true}, current_timestamp=1719219532626333, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2024-06-24 16:58:52.628293] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=42] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1004 , snapshot_version=1719219412618631000, snapshot_type=1, create_time=1719219412619830, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.628303] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [162940][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=51] finish to resize log external storage handler(current_ts=1719219532628292, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:52.628348] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=36] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1004 , snapshot_version=1719219412155330001, snapshot_type=2, create_time=1719219412619830, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.628381] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=23] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1004 , snapshot_version=1719219412155330000, snapshot_type=3, create_time=1719219412619830, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.628407] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:707) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=17] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1004 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1719219412619830, addr="172.20.17.86:2882", gc_status=0) [2024-06-24 16:58:52.628620] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:618) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=18] succeed to update global reserved snapshot(ret=0, this={this:0x7f4721f061f0, last_study_timestamp:1719219412625565, last_refresh_timestamp:1719219472625320, last_reclaim_timestamp:1719219412630009, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219412155330000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1719219412155330000, v:0}, reserved_snapshot={val:1719219412155330000, v:0}) [2024-06-24 16:58:52.628672] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:552) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=51] multi-version garbage collector refresh successfully(this={this:0x7f4721f061f0, last_study_timestamp:1719219412625565, last_refresh_timestamp:1719219472625320, last_reclaim_timestamp:1719219412630009, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219412155330000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1719219412155330000, v:0}, reserved_snapshot_type:3, reserved_status:-1, reserved_create_time:1719219412619830, reserved_addr:"172.20.17.86:2882", is_this_server_disabled:false, status:0}) [2024-06-24 16:58:52.628706] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:231) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=32] repeat refresh successfully(ret=0, this={this:0x7f4721f061f0, last_study_timestamp:1719219412625565, last_refresh_timestamp:1719219532628705, last_reclaim_timestamp:1719219412630009, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219412155330000, v:0}, is_inited:true}, current_timestamp=1719219532626381, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2024-06-24 16:58:52.628730] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:266) [1400][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=23] skip repeat reclaim(ret=0, this={this:0x7f4721f061f0, last_study_timestamp:1719219412625565, last_refresh_timestamp:1719219532628705, last_reclaim_timestamp:1719219412630009, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1719219412155330000, v:0}, is_inited:true}, current_timestamp=1719219532628729, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2024-06-24 16:58:52.630032] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC3D-0-0] [lt=33][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103428721399, cache_obj->added_lc()=false, cache_obj->get_object_id()=9377, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:52.660250] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8E81-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.663175] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.663197] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8E83-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.670375] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219532669589000, start_id=1719219532669589000, end_id=1719219532669589001) [2024-06-24 16:58:52.675888] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=391, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:52.675918] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:52.675932] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:52.675959] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=476, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:52.675976] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=19, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:52.680132] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1719219532680128, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-06-24 16:58:52.683955] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=21] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13762, offset=3456972}, end_cursor:ObLogCursor{file_id=1, log_id=13763, offset=3457245}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d5c050, len:4148, log_data_len:273, seq:13762, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:52.686715] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91B-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219532686445000, start_id=1719219532686445000, end_id=1719219532686445001) [2024-06-24 16:58:52.686787] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91B-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8374, avg_group_log_size=492) [2024-06-24 16:58:52.686809] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91B-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8373) [2024-06-24 16:58:52.687166] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8374) [2024-06-24 16:58:52.687202] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8374) [2024-06-24 16:58:52.687222] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=365, avg_log_submit_to_slide_time=369) [2024-06-24 16:58:52.687633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.687743] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=25] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13763, offset=3457245}, end_cursor:ObLogCursor{file_id=1, log_id=13764, offset=3457510}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d64050, len:3875, log_data_len:265, seq:13763, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:52.700829] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:52.714188] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8EC7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.721024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283362553856, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:52.728178] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD59-0-0] [lt=28] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:52.731329] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=27] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:52.731810] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219532730757000, start_id=1719219532730757000, end_id=1719219532730757001) [2024-06-24 16:58:52.731892] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3539, avg_group_log_size=353) [2024-06-24 16:58:52.731919] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3539) [2024-06-24 16:58:52.732276] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=650, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:52.732309] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:52.739236] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [163714][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=62] BlockGCTimerTask success(ret=0, cost_time_us=15, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):22118, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):22118, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):460, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:52.751208] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=59] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:52.757692] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219532757117000, start_id=1719219532757117000, end_id=1719219532757117001) [2024-06-24 16:58:52.763233] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.763766] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=48481, mem_used=172618752) [2024-06-24 16:58:52.776016] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1342) [2024-06-24 16:58:52.782268] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:52.782299] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:52.782697] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=454, avg_log_submit_to_slide_time=464) [2024-06-24 16:58:52.787656] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.795420] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219532795175000, start_id=1719219532795175000, end_id=1719219532795175001) [2024-06-24 16:58:52.795491] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:52.795523] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:52.795836] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=347, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:52.795854] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:52.795878] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=4, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:52.795906] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=399, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:52.795923] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=17, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:52.812467] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:52.812501] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:52.812530] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=53522067, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:52.817771] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219532817373000, start_id=1719219532817373000, end_id=1719219532817373001) [2024-06-24 16:58:52.818365] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:52.827801] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=18] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=29, mem_used=49913856) [2024-06-24 16:58:52.827842] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=30] release old cannot free more memory [2024-06-24 16:58:52.827859] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=59, size_used=0, mem_used=49913856) [2024-06-24 16:58:52.827965] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82800000, replace_num=100000) [2024-06-24 16:58:52.827993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:52.828278] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221494484, support_ssl=false) [2024-06-24 16:58:52.828350] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=37] sm conn init succ(conn.sessid_=3221494484, sess.client_addr_="172.20.17.86:49538") [2024-06-24 16:58:52.828375] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494484, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:52.828436] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=35][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494484, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:52.828469] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=29] kill and revert session(conn.sessid_=3221494484, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:52.828488] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494484, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:52.828513] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=23] mark session id unused(conn.sessid_=3221494484) [2024-06-24 16:58:52.828524] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162508][sql_nio18][T0][Y0-0000000000000000-0-0] [lt=9] connection close(sessid=3221494484, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:52.838753] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=26] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:52.838788] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:52.838808] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1253) [2024-06-24 16:58:52.857409] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=19] current monitor number(seq_=-1) [2024-06-24 16:58:52.863290] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.870462] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219532870164000, start_id=1719219532870164000, end_id=1719219532870164001) [2024-06-24 16:58:52.870465] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219532870164000, start_id=1719219532870164000, end_id=1719219532870164001) [2024-06-24 16:58:52.870549] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] gts statistics(tenant_id=1003, gts_rpc_cnt=10, get_gts_cache_cnt=416, get_gts_with_stc_cnt=61, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=61, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:52.873371] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873410] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873539] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873672] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873684] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873687] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873686] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873750] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873861] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.873869] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874212] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874505] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8F83-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:52.874577] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874580] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874589] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=8] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874678] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.874754] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:52.876016] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1342) [2024-06-24 16:58:52.876035] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1342) [2024-06-24 16:58:52.876069] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=390, avg_log_submit_to_slide_time=400) [2024-06-24 16:58:52.877687] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042D8A-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:52.882370] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1679, avg_group_log_size=167) [2024-06-24 16:58:52.882412] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2096) [2024-06-24 16:58:52.882708] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1679) [2024-06-24 16:58:52.882746] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1679) [2024-06-24 16:58:52.882779] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=425, avg_log_submit_to_slide_time=435) [2024-06-24 16:58:52.883213] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8F91-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.885949] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10770A0-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.887714] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.889506] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042D93-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:52.891153] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042D94-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219532890232000, start_id=1719219532890232000, end_id=1719219532890232001) [2024-06-24 16:58:52.891593] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [825][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=55] BlockGCTimerTask success(ret=0, cost_time_us=8, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"172.20.17.86:2882", log_dir:"/data/1/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):2457, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):2457, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):131, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2024-06-24 16:58:52.905510] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8FB7-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219532905023000, start_id=1719219532905023000, end_id=1719219532905023001) [2024-06-24 16:58:52.908213] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:52.908463] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CC-0-0] [lt=32] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219548711542000, latest_log_ts:{val:1719219532131098001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:52.908607] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CC-0-0] [lt=137] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:52.912387] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:52.917280] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10770D0-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:52.920074] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10770D2-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:52.921374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283360456704, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:52.923781] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=34][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:52.924787] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A8FD2-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.927778] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:52.927930] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:52.928182] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:52.928255] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:52.928417] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:52.928489] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:52.928620] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042DAE-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:52.931666] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219532931436000, start_id=1719219532931436000, end_id=1719219532931436001) [2024-06-24 16:58:52.939046] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10770E8-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:52.940657] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=12] Garbage Collector is running(seq_=619, gc_interval=10000000) [2024-06-24 16:58:52.940731] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=35] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:52.940767] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=19] gc_check_member_list_ cost time(ret=0, time_us=73) [2024-06-24 16:58:52.940786] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=0) [2024-06-24 16:58:52.942721] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=13] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:52.942758] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=31] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:52.942783] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=23] execute_gc cost time(ret=0, time_us=25) [2024-06-24 16:58:52.942797] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [1577][T1003_GCCollect][T1003][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:52.957828] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219532956779000, start_id=1719219532956779000, end_id=1719219532956779001) [2024-06-24 16:58:52.958968] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=24] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:52.963349] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.963709] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2024-06-24 16:58:52.975697] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:52.975740] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:52.975790] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:52.976109] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=342, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:52.980370] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107711C-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:52.982968] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107711D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:52.987767] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:52.995763] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219532994771000, start_id=1719219532994771000, end_id=1719219532994771001) [2024-06-24 16:58:52.998063] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=46] LogLoopThread round_cost_time(us)(round_cost_time=18) [2024-06-24 16:58:53.002454] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:153) [1472][T1003_COMMONLSS][T1003][YB42AC141156-00061B9D9940D8AF-0-0] [lt=37][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2024-06-24 16:58:53.003716] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:53.013569] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:174) [1331][T1004_CdcSrv][T1004][Y0-0000000000000000-0-0] [lt=13] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2024-06-24 16:58:53.013605] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [1331][T1004_CdcSrv][T1004][Y0-0000000000000000-0-0] [lt=33] finish to resize log external storage handler(current_ts=1719219533013602, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:53.017880] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219533016977000, start_id=1719219533016977000, end_id=1719219533016977001) [2024-06-24 16:58:53.028076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:53.036527] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A906B-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.036703] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2024-06-24 16:58:53.036726] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=17] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:53.036847] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=348894886, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:53.047547] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=11] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16515, offset=3763717}, end_cursor:ObLogCursor{file_id=1, log_id=16516, offset=3763990}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d60050, len:507, log_data_len:273, seq:16515, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:53.049771] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90C-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219533049745000, start_id=1719219533049745000, end_id=1719219533049745001) [2024-06-24 16:58:53.049820] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90C-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7875, avg_group_log_size=605) [2024-06-24 16:58:53.049834] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90C-0-0] [lt=12] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7876) [2024-06-24 16:58:53.050133] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7875) [2024-06-24 16:58:53.050166] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7875) [2024-06-24 16:58:53.050203] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=368, avg_log_submit_to_slide_time=377) [2024-06-24 16:58:53.050474] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1719219533050472, bytes: 171063697, bw: 0.019928 MB/s, add_ts: 1007618, add_bytes: 21055 [2024-06-24 16:58:53.050715] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=32] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16516, offset=3763990}, end_cursor:ObLogCursor{file_id=1, log_id=16517, offset=3764255}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d68050, len:4330, log_data_len:265, seq:16516, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:53.056428] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:53.063406] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.067032] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 372.50) [2024-06-24 16:58:53.067061] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:53.067157] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 6144.00, iops: 2.00, rt: 358.50) [2024-06-24 16:58:53.067173] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:53.067206] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067225] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067240] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067253] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067273] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067287] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067300] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067314] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067328] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067341] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067355] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067366] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067377] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067393] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067406] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.067420] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:53.070603] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219533069829000, start_id=1719219533069829000, end_id=1719219533069829001) [2024-06-24 16:58:53.075772] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1342, avg_group_log_size=122) [2024-06-24 16:58:53.075802] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1342) [2024-06-24 16:58:53.087824] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096748] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096868] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096995] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096994] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.096994] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097134] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097139] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097156] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097159] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097163] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097172] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097397] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097422] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097428] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097428] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097562] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097674] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097795] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097878] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097871] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097876] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097882] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.097966] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098006] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098004] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098163] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098179] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098192] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1260, mem_used=4159488) [2024-06-24 16:58:53.098318] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098323] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=6] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098399] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098439] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098473] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098502] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098509] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098532] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098532] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098548] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098638] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=7] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098753] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098749] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098767] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098867] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.098982] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.099047] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.121756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283362553856, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:53.132008] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219533131146000, start_id=1719219533131146000, end_id=1719219533131146001) [2024-06-24 16:58:53.132183] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=18723318, clean_num=201326) [2024-06-24 16:58:53.132485] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=75, avg_log_gen_to_submit_time=85, avg_log_submit_to_flush_time=651, avg_log_submit_to_slide_time=657) [2024-06-24 16:58:53.135403] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=10] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:53.138354] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=45] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2024-06-24 16:58:53.140268] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=36] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2024-06-24 16:58:53.140296] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1001) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=25] no transfer partition job [2024-06-24 16:58:53.140316] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1031) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=16] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer={value_str:"True"}) [2024-06-24 16:58:53.144001] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=20] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2024-06-24 16:58:53.144054] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:482) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=38] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2024-06-24 16:58:53.147703] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=38][errcode=-4152] get obj error(ret=-4152) [2024-06-24 16:58:53.147795] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [163732][T1002_TBalance][T1002][YB42AC141156-00061B9D9290C34F-0-0] [lt=29] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1719213346325391, last_statistic_bg_stat_time=1719215758515812, last_statistic_schema_version=1719215719009064, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2024-06-24 16:58:53.158016] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219533157540000, start_id=1719219533157540000, end_id=1719219533157540001) [2024-06-24 16:58:53.163464] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.175926] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:53.176298] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:53.176325] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:53.176352] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=424, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:53.176370] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:53.176394] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:53.176421] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=438, avg_log_submit_to_slide_time=447) [2024-06-24 16:58:53.176587] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=31] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:53.177661] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D904-0-0] [lt=8] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:53.177680] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D904-0-0] [lt=17] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:53.178688] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E9-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:53.178722] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8E9-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:53.187880] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.195154] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] success to update min reserved snapshot(reserved_snapshot=1719217727132319000, duration=1800, snapshot_gc_ts=1719219527132319000) [2024-06-24 16:58:53.195589] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=32455431, this={dio_aligned_buf:{buf_write_offset:2935, buf_padding_size:1161, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:83864, truncate_used_ts:21060}, log_block_size:67108864, dir_fd:671, io_fd:673}, aligned_buf_len=4096, aligned_block_offset=32452608, buf_len=112, total_write_size_=12865, total_write_size_after_dio_=393216, ob_pwrite_used_ts=35044, count=93, each_pwrite_cost=376) [2024-06-24 16:58:53.195815] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=18] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217727132319000) [2024-06-24 16:58:53.195899] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9145-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:53.195926] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219533195568000, start_id=1719219533195568000, end_id=1719219533195568001) [2024-06-24 16:58:53.196240] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=48029063, this={dio_aligned_buf:{buf_write_offset:3575, buf_padding_size:521, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:320910, truncate_used_ts:35094}, log_block_size:67108864, dir_fd:675, io_fd:677}, aligned_buf_len=4096, aligned_block_offset=48025600, buf_len=112, total_write_size_=73102, total_write_size_after_dio_=720896, ob_pwrite_used_ts=56873, count=159, each_pwrite_cost=357) [2024-06-24 16:58:53.196483] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=17] update reserved snapshot finished(cost_ts=1332, reserved_snapshot=1719217727132319000) [2024-06-24 16:58:53.198715] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9147-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:53.202385] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:53.203640] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A914C-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:53.206225] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A914E-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:53.208997] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077247-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:53.217863] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [958][T1001_TenantWea][T1001][YB42AC141156-00061B9D8D71391C-0-0] [lt=33] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.582587862014770508e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=379, Throttle Trigger(MB)=227, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.486771494254937807e+02) [2024-06-24 16:58:53.218099] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] get number(ret=0, service_type_=0, range=1, base_id=1719219533217768000, start_id=1719219533217768000, end_id=1719219533217768001) [2024-06-24 16:58:53.228169] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:53.231650] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9173-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:53.234478] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077265-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.238672] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9180-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:53.241220] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:53.241316] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:53.241492] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:53.241550] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:53.241704] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:53.241771] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:53.241860] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107726F-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:53.247836] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:53.247881] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:53.248277] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=4, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:53.248290] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=432, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:53.248297] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:53.251725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042E91-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:53.263523] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.270720] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] get number(ret=0, service_type_=0, range=1, base_id=1719219533270580000, start_id=1719219533270580000, end_id=1719219533270580001) [2024-06-24 16:58:53.282566] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:53.282594] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] try gc retain ctx [2024-06-24 16:58:53.282654] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] get_max_applied_scn(scn={val:1719219532905023002, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32451447}, palf_committed_end_scn_:{val:1719219532905023002, v:0}, last_check_scn_:{val:1719219532905023002, v:0}, max_applied_cb_scn_:{val:1719219532905023002, v:0}}) [2024-06-24 16:58:53.282694] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:53.283323] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=10] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:53.283361] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=34] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:53.283382] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:53.283404] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:53.284931] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=95] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219530580201000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:53.285447] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1201) [2024-06-24 16:58:53.287123] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=121] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219530580201000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:53.287866] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10772A8-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:53.287936] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.290666] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042EB2-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:53.291094] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854 [2024-06-24 16:58:53.292915] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1817] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:53.301947] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:53.301976] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:53.302003] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=15] cannot_recycle_log_size statistics(cannot_recycle_log_size=70423824, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:53.317848] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [162981][T1_MediumLoop][T1][YB42AC141156-00061B9D8A80C252-0-0] [lt=32] MediumCheckTask(cost_ts=36) [2024-06-24 16:58:53.327738] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112531, mem_used=264127488) [2024-06-24 16:58:53.332092] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219533331770000, start_id=1719219533331770000, end_id=1719219533331770001) [2024-06-24 16:58:53.332549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283358359552, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:53.333489] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:53.333990] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10772E1-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219533333878000, start_id=1719219533333878000, end_id=1719219533333878001) [2024-06-24 16:58:53.337144] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042ED6-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219533337040000, start_id=1719219533337040000, end_id=1719219533337040001) [2024-06-24 16:58:53.339798] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10772E6-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.341745] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A370-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219533341247000, start_id=1719219533341247000, end_id=1719219533341247001) [2024-06-24 16:58:53.344571] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:53.358098] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219533357088000, start_id=1719219533357088000, end_id=1719219533357088001) [2024-06-24 16:58:53.360113] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=22] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:53.363579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.371331] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219533370815000, start_id=1719219533370815000, end_id=1719219533370815001) [2024-06-24 16:58:53.371378] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=465, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:53.371409] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:53.371892] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219533371866], gts:1719219533370815000, latest_srr:[mts=1719219533371866]}) [2024-06-24 16:58:53.375993] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:53.376025] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:53.382658] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=113] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:53.382694] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:53.383043] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=394, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:53.383082] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:53.383099] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:53.383127] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=471, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:53.383140] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=25, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:53.387992] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=10][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.396014] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219533395093000, start_id=1719219533395093000, end_id=1719219533395093001) [2024-06-24 16:58:53.398465] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=44] LogLoopThread round_cost_time(us)(round_cost_time=16) [2024-06-24 16:58:53.400125] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:704) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1719217726802034000, duration=1800, snapshot_gc_ts=1719219526802034000) [2024-06-24 16:58:53.400547] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=45099797, this={dio_aligned_buf:{buf_write_offset:2949, buf_padding_size:1147, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:88217, truncate_used_ts:22768}, log_block_size:67108864, dir_fd:686, io_fd:688}, aligned_buf_len=4096, aligned_block_offset=45096960, buf_len=112, total_write_size_=13841, total_write_size_after_dio_=425984, ob_pwrite_used_ts=39293, count=101, each_pwrite_cost=389) [2024-06-24 16:58:53.400687] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=24] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1719217726802034000) [2024-06-24 16:58:53.401098] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=57997941, this={dio_aligned_buf:{buf_write_offset:2789, buf_padding_size:1307, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:102515, truncate_used_ts:26550}, log_block_size:67108864, dir_fd:690, io_fd:692}, aligned_buf_len=4096, aligned_block_offset=57995264, buf_len=112, total_write_size_=12294, total_write_size_after_dio_=425984, ob_pwrite_used_ts=39675, count=101, each_pwrite_cost=392) [2024-06-24 16:58:53.401212] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:188) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=21] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1719217726802034000) [2024-06-24 16:58:53.401236] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:731) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=21] update reserved snapshot finished(cost_ts=1115, reserved_snapshot=1719217726802034000) [2024-06-24 16:58:53.417819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219533417259000, start_id=1719219533417259000, end_id=1719219533417259001) [2024-06-24 16:58:53.422324] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129959, mem_used=326519808) [2024-06-24 16:58:53.428266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:53.442513] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B5-0-0] [lt=83][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:53.442539] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B5-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:53.457805] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:53.459804] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:53.459843] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=38] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:53.459884] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=33] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:53.460022] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219530866633001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:53.460124] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:53.460168] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=36] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:53.460188] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=0, rec_log_ts={val:1719219527359914001, v:0}) [2024-06-24 16:58:53.460200] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:53.460219] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=10] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:53.460245] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:53.460265] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:53.462214] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=10] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:53.462240] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=26] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:53.462267] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:53.462471] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=20] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219530866633001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:53.462563] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=87] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:53.462578] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:53.462597] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:53.462615] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:53.462642] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:53.462652] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=9] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:53.463633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.470799] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219533470042000, start_id=1719219533470042000, end_id=1719219533470042001) [2024-06-24 16:58:53.470875] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:53.470909] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:53.471232] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=346, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:53.471257] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:53.471270] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=4, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:53.471285] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=395, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:53.471292] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=6] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=13, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:53.472168] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=8] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:53.472195] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=22] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:53.472216] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:53.472232] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:53.477648] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:53.477674] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=24] try gc retain ctx [2024-06-24 16:58:53.477707] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] get_max_applied_scn(scn={val:1719219533417259000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70425125}, palf_committed_end_scn_:{val:1719219533470042000, v:0}, last_check_scn_:{val:1719219533470042000, v:0}, max_applied_cb_scn_:{val:1719219533417259000, v:0}}) [2024-06-24 16:58:53.477743] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=32] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:53.477779] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=10] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:53.478062] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=280] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:53.480102] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=102] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219547830421000, latest_log_ts:{val:1719219531216126001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:53.482603] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:53.482743] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:53.482769] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:53.483123] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=361, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:53.483152] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:53.483168] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=9] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=8, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:53.483185] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=417, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:53.483198] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=23, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:53.488048] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.496750] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A92E0-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:53.499787] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10773C4-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:53.505365] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042F3F-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:53.508213] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A92F2-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:53.511107] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A92F5-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:53.532250] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219533531281000, start_id=1719219533531281000, end_id=1719219533531281001) [2024-06-24 16:58:53.532721] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3413) [2024-06-24 16:58:53.532772] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=7] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3413) [2024-06-24 16:58:53.532927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283358359552, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:53.532917] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219533331770000, v:0}, new_max_version={val:1719219533331770000, v:0}, last_min_version={val:1719219533131146000, v:0}, last_max_version={val:1719219533131146000, v:0}, total_time_us=2675, delta_us=201145) [2024-06-24 16:58:53.535245] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9314-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:53.538320] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042F57-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.540735] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=33] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:53.542704] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A931E-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:53.545595] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:53.549237] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:53.549431] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:53.549491] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:53.549644] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:53.549713] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:53.549802] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9324-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:53.558391] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219533557693000, start_id=1719219533557693000, end_id=1719219533557693001) [2024-06-24 16:58:53.559105] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219533357088000, v:0}, min_version={val:1719219533357088000, v:0}, max_version={val:1719219533357088000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:53.562374] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077415-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:53.563705] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.575340] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=19] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:53.576966] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=30] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:53.577061] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=27] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526709080000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:53.583200] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1201) [2024-06-24 16:58:53.588104] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.592692] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9370-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:53.595413] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107743E-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:53.596219] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219533595745000, start_id=1719219533595745000, end_id=1719219533595745001) [2024-06-24 16:58:53.617911] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219533616859000, start_id=1719219533616859000, end_id=1719219533616859001) [2024-06-24 16:58:53.621909] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:53.622069] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=13] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:53.628355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:53.634677] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC3E-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103429726050, cache_obj->added_lc()=false, cache_obj->get_object_id()=9378, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:53.636389] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A93C7-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.663757] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.670989] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219533670769000, start_id=1719219533670769000, end_id=1719219533670769001) [2024-06-24 16:58:53.671491] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] [APPLY STAT CB APPEND COST TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=32, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:53.671522] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=391, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:53.671540] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:53.671554] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=-476, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:53.671565] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=10] [APPLY STAT CB TOTAL TIME](cur_stat_count=50, stat_interval=5000000, avg (count/cost)=-52, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:53.673128] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=8] Garbage Collector is running(seq_=619, gc_interval=10000000) [2024-06-24 16:58:53.673224] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=36] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:53.673248] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=19] self is leader, skip it(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:53.673274] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=108) [2024-06-24 16:58:53.673293] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=13] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:53.675308] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=13] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:53.676600] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=394, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:53.676648] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:53.676671] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:53.676699] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=475, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:53.676716] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=22, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:53.677124] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=30] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:53.677158] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=29] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:53.677183] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:53.677201] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=17] execute_gc cost time(ret=0, time_us=44) [2024-06-24 16:58:53.677216] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [1351][T1004_GCCollect][T1004][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2024-06-24 16:58:53.687747] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1719219533687743, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-06-24 16:58:53.688159] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.691177] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=23] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13764, offset=3457510}, end_cursor:ObLogCursor{file_id=1, log_id=13765, offset=3457783}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d6c050, len:3610, log_data_len:273, seq:13764, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:53.694013] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91C-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219533693998000, start_id=1719219533693998000, end_id=1719219533693998001) [2024-06-24 16:58:53.694092] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91C-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8374, avg_group_log_size=492) [2024-06-24 16:58:53.694123] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91C-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8374) [2024-06-24 16:58:53.694467] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8374) [2024-06-24 16:58:53.694500] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=5] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8374) [2024-06-24 16:58:53.694519] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=372, avg_log_submit_to_slide_time=377) [2024-06-24 16:58:53.695073] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=34] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13765, offset=3457783}, end_cursor:ObLogCursor{file_id=1, log_id=13766, offset=3458048}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d70050, len:3337, log_data_len:265, seq:13765, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:53.695702] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:153) [841][T1001_COMMONLSS][T1001][YB42AC141156-00061B9D92A0D8CD-0-0] [lt=36][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2024-06-24 16:58:53.700894] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:53.709879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [1615][T1003_SSTableGC][T1003][YB42AC141156-00061B9D99C0C1B2-0-0] [lt=22] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217726749170000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217726749170000) [2024-06-24 16:58:53.719464] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:124) [1615][T1003_SSTableGC][T1003][YB42AC141156-00061B9D99C0C1B2-0-0] [lt=42] SSTableGCTask(cost_ts=10250) [2024-06-24 16:58:53.721953] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [162333][Blacklist][T0][Y0-0000000000000000-0-0] [lt=50] blacklist_loop exec finished(cost_time=46, is_enabled=true, send_cnt=0) [2024-06-24 16:58:53.723578] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:53.723614] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=26] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:53.723671] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=42] cannot_recycle_log_size statistics(cannot_recycle_log_size=103090502, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:53.731414] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=21] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:53.731706] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=27] ====== tenant freeze timer task ====== [2024-06-24 16:58:53.732304] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219533732050000, start_id=1719219533732050000, end_id=1719219533732050001) [2024-06-24 16:58:53.732391] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3413, avg_group_log_size=379) [2024-06-24 16:58:53.732419] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3413) [2024-06-24 16:58:53.732779] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A380-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219533732050000, start_id=1719219533732050000, end_id=1719219533732050001) [2024-06-24 16:58:53.732771] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=367, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:53.732809] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=16, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:53.733298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283352068096, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:53.738869] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A38E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:53.739081] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A38E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:53.748777] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A398-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=33, bitmap=NULL) [2024-06-24 16:58:53.748980] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A398-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=44, pos=29, bitmap=NULL) [2024-06-24 16:58:53.756860] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A39C-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:53.756978] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A39C-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:53.757196] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A39C-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:53.757383] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A39C-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:53.757507] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A39C-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:53.758245] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138BC-0-0] [lt=23] adaptive update(Tenant ID=1003, Config Specify Resource Limit(MB)=819, TxShare Current Memory Limit(MB)=668, Holding Memory(MB)=49, Tenant Remain Memory(MB)=1032, Usable Remain Memory(MB)=619, Last Update Limit Timestamp=1719219533757542, Is Updated=true) [2024-06-24 16:58:53.758427] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219533757542000, start_id=1719219533757542000, end_id=1719219533757542001) [2024-06-24 16:58:53.761268] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=24] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:53.761568] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A94C4-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:53.763466] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A94C8-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:53.763818] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.763903] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] sql audit evict mem start(request_manager_->get_tenant_id()=1002, evict_low_mem_level=135291469, evict_high_mem_level=180388626, size_used=52098, mem_used=180937728) [2024-06-24 16:58:53.767322] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A94CD-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:53.769305] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A94CF-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:53.773102] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077505-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:53.776661] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1332) [2024-06-24 16:58:53.782916] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1201, avg_group_log_size=120) [2024-06-24 16:58:53.782948] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1201) [2024-06-24 16:58:53.783344] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=431, avg_log_submit_to_slide_time=442) [2024-06-24 16:58:53.788217] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.796584] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219533795614000, start_id=1719219533795614000, end_id=1719219533795614001) [2024-06-24 16:58:53.796679] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=36] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:53.796720] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:53.797116] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=385, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:53.797165] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=13, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:53.797199] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:53.797242] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=447, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:53.797261] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=30, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:53.798273] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A950B-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:53.800367] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A950D-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.803436] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9516-0-0] [lt=18][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:53.805064] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9518-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:53.807483] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:53.807549] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:53.807667] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:53.807709] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:53.807797] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:53.807838] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:53.807889] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A951B-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:53.818140] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219533817749000, start_id=1719219533817749000, end_id=1719219533817749001) [2024-06-24 16:58:53.820697] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042FF9-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:53.821489] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C042FFA-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219533820909000, start_id=1719219533820909000, end_id=1719219533820909001) [2024-06-24 16:58:53.827966] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=14] new mysql sessid created(conn.sessid_=3221494485, support_ssl=false) [2024-06-24 16:58:53.828014] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=17] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=35, mem_used=49913856) [2024-06-24 16:58:53.828064] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=32] release old cannot free more memory [2024-06-24 16:58:53.828079] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=42] sm conn init succ(conn.sessid_=3221494485, sess.client_addr_="172.20.17.86:49540") [2024-06-24 16:58:53.828080] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=14] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=69, size_used=0, mem_used=49913856) [2024-06-24 16:58:53.828105] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f47833c2030, session_id:3221494485, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:53.828205] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=34][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494485, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:53.828244] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=34] kill and revert session(conn.sessid_=3221494485, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:53.828270] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=25] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494485, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:53.828297] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=25] mark session id unused(conn.sessid_=3221494485) [2024-06-24 16:58:53.828312] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162507][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=14] connection close(sessid=3221494485, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:53.828444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:53.850207] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9566-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:53.852096] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9568-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:53.857526] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=22] current monitor number(seq_=-1) [2024-06-24 16:58:53.858382] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4A1-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:53.858509] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4A1-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:53.863072] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4A3-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=178, pos=121, bitmap=NULL) [2024-06-24 16:58:53.863876] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.871287] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219533870431000, start_id=1719219533870431000, end_id=1719219533870431001) [2024-06-24 16:58:53.872274] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219533871485000, start_id=1719219533871485000, end_id=1719219533871485001) [2024-06-24 16:58:53.872309] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=29] ts response task statistics(alloc_count=248922, free_count=124460) [2024-06-24 16:58:53.872340] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=17] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219533872261], gts:1719219533871485000, latest_srr:[mts=1719219533872261]}) [2024-06-24 16:58:53.872386] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219533872370], gts:1719219533871485000, latest_srr:[mts=1719219533872370]}) [2024-06-24 16:58:53.872416] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219533872403], gts:1719219533871485000, latest_srr:[mts=1719219533872403]}) [2024-06-24 16:58:53.872449] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219533872436], gts:1719219533871485000, latest_srr:[mts=1719219533872436]}) [2024-06-24 16:58:53.873651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.873774] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.873779] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874090] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874257] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874265] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874265] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874458] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874499] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874596] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874639] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874635] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874653] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874695] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874696] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874720] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874729] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.874727] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:53.876768] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1332) [2024-06-24 16:58:53.876794] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1332) [2024-06-24 16:58:53.876831] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=424, avg_log_submit_to_slide_time=433) [2024-06-24 16:58:53.880758] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=1, elapse_time=116856, size_used=2760, mem_used=72791040) [2024-06-24 16:58:53.888273] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.891413] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A95AA-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:53.907947] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:53.908084] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:53.908132] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:53.908178] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:53.908263] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:53.908404] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:53.908454] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:53.908495] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:53.908660] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:53.908705] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:53.908779] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:53.908819] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:53.908932] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:53.908972] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:53.909011] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:53.909074] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:53.909185] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:53.909228] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:53.909266] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:53.909303] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:53.909379] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:53.909422] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=10][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:53.909507] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:53.909550] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4B2-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:53.910034] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077590-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219533909452000, start_id=1719219533909452000, end_id=1719219533909452001) [2024-06-24 16:58:53.910158] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077590-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=5782, avg_group_log_size=361) [2024-06-24 16:58:53.910190] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077590-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=5365) [2024-06-24 16:58:53.910532] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=5782) [2024-06-24 16:58:53.910580] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=5782) [2024-06-24 16:58:53.910611] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=414, avg_log_submit_to_slide_time=423) [2024-06-24 16:58:53.912450] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:53.923705] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A95E7-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719219533923205000, start_id=1719219533923205000, end_id=1719219533923205001) [2024-06-24 16:58:53.932487] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219533931632000, start_id=1719219533931632000, end_id=1719219533931632001) [2024-06-24 16:58:53.932608] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A4CA-0-0] [lt=7] get number(ret=0, service_type_=0, range=1, base_id=1719219533931632000, start_id=1719219533931632000, end_id=1719219533931632001) [2024-06-24 16:58:53.933820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283461120000, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:53.958533] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219533958031000, start_id=1719219533958031000, end_id=1719219533958031001) [2024-06-24 16:58:53.963934] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.976415] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:53.976469] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:53.976513] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2024-06-24 16:58:53.976878] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=388, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:53.988329] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:53.996423] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219533995904000, start_id=1719219533995904000, end_id=1719219533995904001) [2024-06-24 16:58:54.003796] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:54.004870] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=24] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261355958272) [2024-06-24 16:58:54.018498] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219534018035000, start_id=1719219534018035000, end_id=1719219534018035001) [2024-06-24 16:58:54.019087] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:54.025300] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A967A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.027394] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A967C-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.027435] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=41] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:54.028536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:54.031171] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9681-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.033170] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9684-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.035126] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9686-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.053305] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A969C-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.053935] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=20] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16517, offset=3764255}, end_cursor:ObLogCursor{file_id=1, log_id=16518, offset=3764528}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d78050, len:4065, log_data_len:273, seq:16517, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:54.056469] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077612-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.056576] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=18] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:54.058091] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1719219534058088, bytes: 171083337, bw: 0.018589 MB/s, add_ts: 1007616, add_bytes: 19640 [2024-06-24 16:58:54.058547] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90D-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219534058057000, start_id=1719219534058057000, end_id=1719219534058057001) [2024-06-24 16:58:54.058652] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90D-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7764, avg_group_log_size=647) [2024-06-24 16:58:54.058681] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90D-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7763) [2024-06-24 16:58:54.059029] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7764) [2024-06-24 16:58:54.059086] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7764) [2024-06-24 16:58:54.059131] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=442, avg_log_submit_to_slide_time=455) [2024-06-24 16:58:54.059719] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=34] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16518, offset=3764528}, end_cursor:ObLogCursor{file_id=1, log_id=16519, offset=3764793}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d74050, len:3792, log_data_len:265, seq:16518, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:54.059725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96A6-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.062246] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:54.062312] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:54.062418] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:54.062453] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:54.062538] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:54.062577] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:54.062642] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96AC-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:54.064000] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.069319] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 358.50) [2024-06-24 16:58:54.069349] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:54.069445] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 393.50) [2024-06-24 16:58:54.069466] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:54.069499] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069519] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069538] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069552] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069563] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069579] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069593] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069607] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069644] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069658] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069672] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069686] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069700] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069713] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069730] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.069744] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:54.071164] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534070682000, start_id=1719219534070682000, end_id=1719219534070682001) [2024-06-24 16:58:54.073609] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96C0-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.076484] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2024-06-24 16:58:54.076519] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1332) [2024-06-24 16:58:54.084207] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB82-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103430175579, cache_obj->added_lc()=false, cache_obj->get_object_id()=9379, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:54.085397] WDIAG get_refactored (ob_hashtable.h:1102) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB84-0-0] [lt=18][errcode=-4201] hashtable not init [2024-06-24 16:58:54.085408] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB84-0-0] [lt=10][errcode=-4016] get cursor info failed(cursor_id=1154, get_sessid()=3221489125) [2024-06-24 16:58:54.085532] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC40-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219534085425000, start_id=1719219534085425000, end_id=1719219534085425001) [2024-06-24 16:58:54.088387] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.096209] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096393] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096657] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.096662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097062] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097069] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097076] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097107] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097111] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097222] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097360] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097448] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097442] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097473] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097654] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097661] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097668] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097664] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=9] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097671] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097665] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097673] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097674] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097677] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097666] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097677] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097676] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097684] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097692] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097700] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.097774] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098001] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098020] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098295] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098330] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1300, mem_used=4159488) [2024-06-24 16:58:54.098351] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098357] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098359] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098397] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098637] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=9] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098663] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098801] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098930] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.098977] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.099031] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.104825] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96F0-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.106730] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A96F2-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.112680] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=13] ====== check clog disk timer task ====== [2024-06-24 16:58:54.112721] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=28] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:54.112755] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=73670560, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:54.116475] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD26-0-0] [lt=7] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:54.116492] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD26-0-0] [lt=11] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=17) [2024-06-24 16:58:54.132539] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534131920000, start_id=1719219534131920000, end_id=1719219534131920001) [2024-06-24 16:58:54.133048] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=422, avg_log_submit_to_slide_time=434) [2024-06-24 16:58:54.134359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283461120000, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:54.135489] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=9] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:54.144703] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [713][T1002_L0_G0][T1002][YB42AC141156-00061B9D92E11E4B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.158669] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219534158286000, start_id=1719219534158286000, end_id=1719219534158286001) [2024-06-24 16:58:54.162450] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=37] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:54.164058] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.176568] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1332) [2024-06-24 16:58:54.176638] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=22] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:54.177040] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=16, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:54.177078] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:54.177116] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=460, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:54.177101] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=35, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:54.177133] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=31] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=418, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:54.177135] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=27, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:54.177151] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:54.177157] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1332) [2024-06-24 16:58:54.177166] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=-484, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:54.177181] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=14] [APPLY STAT CB TOTAL TIME](cur_stat_count=10, stat_interval=5000000, avg (count/cost)=-31, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:54.177181] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=469, avg_log_submit_to_slide_time=478) [2024-06-24 16:58:54.179616] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D905-0-0] [lt=11] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:54.179669] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D905-0-0] [lt=50] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:54.179719] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EA-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:54.179738] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EA-0-0] [lt=17] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:54.188443] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.190250] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D436-0-0] [lt=15] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.196522] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534196330000, start_id=1719219534196330000, end_id=1719219534196330001) [2024-06-24 16:58:54.202446] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:54.218465] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [958][T1001_TenantWea][T1001][YB42AC141156-00061B9D8D713921-0-0] [lt=33] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.582587862014770508e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=379, Throttle Trigger(MB)=227, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.486771494254937807e+02) [2024-06-24 16:58:54.218714] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1719219534218428000, start_id=1719219534218428000, end_id=1719219534218428001) [2024-06-24 16:58:54.228639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:54.234262] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D484-0-0] [lt=26] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.248443] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:54.248485] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:54.248898] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:54.248921] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=452, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:54.248940] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:54.264118] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.266022] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=14] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:54.267817] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:54.267920] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=30] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526802034000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:54.271284] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219534271134000, start_id=1719219534271134000, end_id=1719219534271134001) [2024-06-24 16:58:54.274814] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776A1-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.277631] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A6BD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.281309] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=36] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:54.282450] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776A5-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.284481] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A97E4-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.284510] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=18] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:54.284536] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=25] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:54.284542] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72B-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:54.284564] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72B-0-0] [lt=20] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:54.287458] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776A7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.288498] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=11][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.305724] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A97FF-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.308798] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [723][T1002_L0_G0][T1002][YB42AC141156-00061B9DA08C946A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.313157] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776B7-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.315984] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:54.316089] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:54.316290] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:54.316356] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:54.316521] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:54.316596] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:54.316710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776BB-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:54.327838] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9825-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.327853] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112554, mem_used=264127488) [2024-06-24 16:58:54.332665] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219534332380000, start_id=1719219534332380000, end_id=1719219534332380001) [2024-06-24 16:58:54.334932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283456925696, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:54.344708] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=30] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:54.353247] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9849-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.355118] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A984B-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.358778] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219534357744000, start_id=1719219534357744000, end_id=1719219534357744001) [2024-06-24 16:58:54.363566] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776D5-0-0] [lt=20] refresh tenant config success(tenant_id=1002, *this={last_refresh_ts:1719219534363030, can_tenant_elr:true}) [2024-06-24 16:58:54.364178] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.373293] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719219534372542000, start_id=1719219534372542000, end_id=1719219534372542001) [2024-06-24 16:58:54.373342] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:54.376721] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:54.376757] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:54.378595] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3730) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=14] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2024-06-24 16:58:54.378646] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3753) [1291][T1004_DagSchedu][T1004][Y0-0000000000000000-0-0] [lt=49] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2024-06-24 16:58:54.383282] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:54.383330] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:54.383796] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=432, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:54.383827] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:54.383862] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:54.383883] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:54.383907] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=518, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:54.383927] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=27, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:54.388552] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.393478] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10776EB-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.396601] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534395765000, start_id=1719219534395765000, end_id=1719219534395765001) [2024-06-24 16:58:54.396606] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [162299][AutoLSLocRpc][T0][YB42AC141156-00061B9D89F0D963-0-0] [lt=103] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["172.20.17.86:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1003, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1004, ls_id:{id:1}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}, {key:{tenant_id:1004, ls_id:{id:1001}, cluster_id:1719213093}, location:{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:1}}]) [2024-06-24 16:58:54.411413] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D44A-0-0] [lt=27] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.411618] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D44C-0-0] [lt=27] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.418830] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219534417971000, start_id=1719219534417971000, end_id=1719219534417971001) [2024-06-24 16:58:54.422497] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129970, mem_used=326519808) [2024-06-24 16:58:54.424271] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:465) [163808][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=13] skip defragment task(ret=0, need_defragment=false) [2024-06-24 16:58:54.424308] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:507) [163808][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=34] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=5) [2024-06-24 16:58:54.424327] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:525) [163808][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=18] successfully defragment data blocks(rewrite_cnt=0) [2024-06-24 16:58:54.424342] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:697) [163808][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=11] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=0, total_skip_cnt=0, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2024-06-24 16:58:54.428727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:54.442663] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:54.445059] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=33] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:54.445107] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=47] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:54.445156] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=42] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:54.445321] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=26] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219547830421000, latest_log_ts:{val:1719219531216126001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:54.445445] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=119] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:54.445477] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:54.445501] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219531216126001, v:0}) [2024-06-24 16:58:54.445518] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:54.445536] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:54.445563] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:54.445595] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:54.445619] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:54.445646] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:54.452574] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B6-0-0] [lt=50][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:54.452607] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B6-0-0] [lt=32][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:54.464236] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.469907] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2024-06-24 16:58:54.471587] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534470549000, start_id=1719219534470549000, end_id=1719219534470549001) [2024-06-24 16:58:54.471693] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:54.471739] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:54.472153] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=352, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:54.472198] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:54.472241] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=5, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:54.472267] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=411, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:54.472281] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=18, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:54.482768] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:54.483383] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:54.483424] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:54.483757] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=442, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:54.483785] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:54.483799] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=6, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:54.483818] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=505, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:54.483836] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=26, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:54.488616] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.508650] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=17] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:54.510424] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:54.510527] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526749170000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:54.510564] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:651) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=34] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1719219526749170000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1003, freeze_info:{latest_snapshot_gc_scn:{val:1719219526749170000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}}) [2024-06-24 16:58:54.511234] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9919-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.514390] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107774E-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.518001] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E94A-0-0] [lt=19] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1719219534517980}) [2024-06-24 16:58:54.518024] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D070-0-0] [lt=12] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2024-06-24 16:58:54.518341] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D070-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219534518312, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:54.518374] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D070-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1719219534517980}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219534518312, sql_renew_time:0, is_mark_fail:false}]) [2024-06-24 16:58:54.519336] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9926-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.520368] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E94A-0-0] [lt=30] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:54.520536] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E94A-0-0] [lt=30][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:54.521266] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9928-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.523165] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9929-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.528433] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=21] ls blacklist refresh finish(cost_time=12138) [2024-06-24 16:58:54.532799] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219534532797000, start_id=1719219534532797000, end_id=1719219534532797001) [2024-06-24 16:58:54.533276] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3972) [2024-06-24 16:58:54.533334] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3972) [2024-06-24 16:58:54.533488] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219534332380000, v:0}, new_max_version={val:1719219534332380000, v:0}, last_min_version={val:1719219534131920000, v:0}, last_max_version={val:1719219534131920000, v:0}, total_time_us=2646, delta_us=201106) [2024-06-24 16:58:54.535464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283459022848, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:54.536119] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash time detail, (compute_wash_size_time=191, refresh_score_time=156, wash_time=0) [2024-06-24 16:58:54.540223] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1192][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=29] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:54.547057] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A993F-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.550313] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107776C-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.554951] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [162298][AutoLSLoc][T1003][YB42AC141156-00061B9D8A40C5C9-0-0] [lt=36][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1748, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:54.555098] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A857-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.557951] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:54.558059] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:54.558261] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:54.558326] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:54.558501] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:54.558579] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:54.558691] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9950-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:54.558885] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219534558105000, start_id=1719219534558105000, end_id=1719219534558105001) [2024-06-24 16:58:54.559519] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219534357744000, v:0}, min_version={val:1719219534357744000, v:0}, max_version={val:1719219534357744000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:54.563615] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=31] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:54.564296] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.564932] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:146) [413][T1002_Compactio][T1002][YB42AC141156-00061B9D9620C1C7-0-0] [lt=33] InfoPoolResizeTask(cost_ts=24) [2024-06-24 16:58:54.570769] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9960-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.583854] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1098) [2024-06-24 16:58:54.588630] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.593654] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D436-0-0] [lt=15] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.596721] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219534596009000, start_id=1719219534596009000, end_id=1719219534596009001) [2024-06-24 16:58:54.601152] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:227) [162289][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=26] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=0) [2024-06-24 16:58:54.606441] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:54.606566] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=124] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:54.606582] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=13] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:54.606680] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=97] get_replay_process success(id={id:1001}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:54.606736] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [163818][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=11] dump tenant replay process(tenant_id=1002, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:54.612638] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3730) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2024-06-24 16:58:54.612671] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3753) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=31] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2024-06-24 16:58:54.613864] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2024-06-24 16:58:54.615005] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9985-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.615296] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1296][T1004_TntTransf][T1004][YB42AC141156-00061B9D9800C34E-0-0] [lt=30] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:54.615666] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1293][T1004_TntTransf][T1004][YB42AC141156-00061B9D97D0C34E-0-0] [lt=42] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:54.618230] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077791-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.618979] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219534618135000, start_id=1719219534618135000, end_id=1719219534618135001) [2024-06-24 16:58:54.621965] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:54.622194] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=19] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:54.628814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:54.630824] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=49] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:54.639972] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [163827][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:54.640093] WDIAG read_multi_row (ob_table_access_helper.h:238) [163827][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:54.640459] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:221) [163827][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:54.641041] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC41-0-0] [lt=25][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103430732409, cache_obj->added_lc()=false, cache_obj->get_object_id()=9380, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:54.642145] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [718][T1002_L0_G0][T1002][YB42AC141156-00061B9DA116A8DF-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:54.644245] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10777AF-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219534643428000, start_id=1719219534643428000, end_id=1719219534643428001) [2024-06-24 16:58:54.650371] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A99A6-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534649752000, start_id=1719219534649752000, end_id=1719219534649752001) [2024-06-24 16:58:54.662848] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:170) [1391][T1004_MediumLoo][T1004][YB42AC141156-00061B9D98C0C24C-0-0] [lt=31] MediumCheckTask(cost_ts=44) [2024-06-24 16:58:54.664356] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.671709] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219534670803000, start_id=1719219534670803000, end_id=1719219534670803001) [2024-06-24 16:58:54.675617] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043078-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219534674993000, start_id=1719219534674993000, end_id=1719219534674993001) [2024-06-24 16:58:54.677231] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10777CC-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.677282] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=398, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:54.677321] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=16, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:54.677332] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:54.677361] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=491, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:54.677376] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=23, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:54.688661] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=12][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.688652] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1294][T1004_TntTransf][T1004][YB42AC141156-00061B9D97E0C34E-0-0] [lt=30] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:54.695362] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1719219534695358, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-06-24 16:58:54.698995] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=22] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13766, offset=3458048}, end_cursor:ObLogCursor{file_id=1, log_id=13767, offset=3458321}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d7c050, len:3072, log_data_len:273, seq:13766, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:54.700965] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:54.702440] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91D-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219534701433000, start_id=1719219534701433000, end_id=1719219534701433001) [2024-06-24 16:58:54.702522] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91D-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8261, avg_group_log_size=516) [2024-06-24 16:58:54.702551] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91D-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8261) [2024-06-24 16:58:54.702918] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8261) [2024-06-24 16:58:54.702969] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8261) [2024-06-24 16:58:54.703002] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=398, avg_log_submit_to_slide_time=407) [2024-06-24 16:58:54.703539] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=41] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13767, offset=3458321}, end_cursor:ObLogCursor{file_id=1, log_id=13768, offset=3458586}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d80050, len:2799, log_data_len:265, seq:13767, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:54.705133] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=26] LogLoopThread round_cost_time(us)(round_cost_time=26) [2024-06-24 16:58:54.717057] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:54.717106] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [363][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=34] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1242) [2024-06-24 16:58:54.719011] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:465) [921][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=20] skip defragment task(ret=0, need_defragment=false) [2024-06-24 16:58:54.719049] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:507) [921][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=35] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2024-06-24 16:58:54.719069] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:525) [921][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=18] successfully defragment data blocks(rewrite_cnt=0) [2024-06-24 16:58:54.719087] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:697) [921][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=14] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=0, total_skip_cnt=0, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2024-06-24 16:58:54.731497] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=20] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:54.732273] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [1295][T1004_TntTransf][T1004][YB42AC141156-00061B9D97F0C34E-0-0] [lt=33] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:54.732951] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219534732034000, start_id=1719219534732034000, end_id=1719219534732034001) [2024-06-24 16:58:54.733426] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=377, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:54.733461] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=19, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:54.734321] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D44A-0-0] [lt=38] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.734483] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D44C-0-0] [lt=32] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:54.735494] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD5A-0-0] [lt=28] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:54.736651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283454828544, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:54.739743] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9A11-0-0] [lt=26][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:54.759088] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219534758423000, start_id=1719219534758423000, end_id=1719219534758423001) [2024-06-24 16:58:54.763767] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=35] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:54.764416] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.765496] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:54.765596] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526812609000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:54.771048] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=18] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:54.771090] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=28] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:54.771108] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=16] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:54.771120] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1382][T1004_ObTimer][T1004][Y0-0000000000000000-0-0] [lt=10] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1221) [2024-06-24 16:58:54.774956] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9A43-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219534774285000, start_id=1719219534774285002, end_id=1719219534774285003) [2024-06-24 16:58:54.782670] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [163826][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=36] report RowHolderMapper summary info(count=2620, bkt_cnt=7851) [2024-06-24 16:58:54.788724] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.793224] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=12] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:54.794858] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:54.794953] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219527132319000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:54.796835] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219534796461000, start_id=1719219534796461000, end_id=1719219534796461001) [2024-06-24 16:58:54.796913] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:54.796948] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:54.797320] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=372, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:54.797357] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:54.797378] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=7, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:54.797407] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=442, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:54.797429] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=29, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:54.805234] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=34] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:68234, max_lsn:45097521, max_scn:{val:1719219534373599004, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:45097521}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:3154481}}, last_submit_lsn:{lsn:45097399}, last_submit_end_lsn:{lsn:45097521}, last_submit_log_id:68234, last_submit_log_pid:1, max_flushed_lsn:{lsn:45097399}, max_flushed_end_lsn:{lsn:45097521}, max_flushed_log_pid:1, committed_end_lsn:{lsn:45097521}, last_slide_log_id:68234, last_slide_scn:{val:1719219534373599004, v:0}, last_slide_lsn:{lsn:45097399}, last_slide_end_lsn:{lsn:45097521}, last_slide_log_pid:1, last_slide_log_accum_checksum:2451110409, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d7a46530}, [StateMgr]={this:0x7f46d7a4a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:68235, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213363223619, palf_role_change_cb:0x7f46d7a50cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d7a47c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1/meta", dir_fd:685, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d7a4c478, flashback_version:0}, log_storage:{log_tail:{lsn:45097521}, readable_log_tail:{lsn:45097521}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1/log", dir_fd:686, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:22007247, block_header_serialize_buf_:0x7f46d7a4e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213363223315, this:0x7f46d7a4a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213363224198, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d7a4a430}) [2024-06-24 16:58:54.805560] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=322] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219534777429, last_flushed_end_lsn:{lsn:45097521}}]) [2024-06-24 16:58:54.805585] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=68235, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219534777429, last_flushed_end_lsn:{lsn:45097521}}]) [2024-06-24 16:58:54.812644] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:54.812686] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=31] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:54.812726] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=24] cannot_recycle_log_size statistics(cannot_recycle_log_size=53529452, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:54.818932] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219534818629000, start_id=1719219534818629000, end_id=1719219534818629001) [2024-06-24 16:58:54.827586] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=18] new mysql sessid created(conn.sessid_=3221494486, support_ssl=false) [2024-06-24 16:58:54.827687] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=32] sm conn init succ(conn.sessid_=3221494486, sess.client_addr_="172.20.17.86:49542") [2024-06-24 16:58:54.827713] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494486, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:54.827817] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494486, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:54.827850] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221494486, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:54.827867] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494486, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:54.827891] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494486) [2024-06-24 16:58:54.827904] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494486, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:54.828194] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=40, mem_used=49913856) [2024-06-24 16:58:54.828242] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=24] release old cannot free more memory [2024-06-24 16:58:54.828257] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=64, size_used=0, mem_used=49913856) [2024-06-24 16:58:54.828898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:54.835919] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077856-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.838906] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AA2-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.844855] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107785D-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.847973] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107785E-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.848793] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4094, avg_group_log_size=372) [2024-06-24 16:58:54.848827] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4557) [2024-06-24 16:58:54.850825] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AB3-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:54.854896] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1080) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=12] replay status is not follower(min_unreplayed_lsn={lsn:0}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:54.854957] INFO [CLOG] operator() (ob_log_replay_service.cpp:1619) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=61] get_replay_process success(id={id:1}, replayed_log_size=0, unreplayed_log_size=0) [2024-06-24 16:58:54.854982] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:159) [931][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=6] dump tenant replay process(tenant_id=1001, unreplayed_log_size(MB)=0, estimate_time(second)=0, replayed_log_size(MB)=0, last_replayed_log_size(MB)=0, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2024-06-24 16:58:54.854972] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:146) [973][T1001_Compactio][T1001][YB42AC141156-00061B9D9660C1C7-0-0] [lt=32] InfoPoolResizeTask(cost_ts=27) [2024-06-24 16:58:54.864473] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:54.864507] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=32] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:54.864527] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.871661] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219534871435000, start_id=1719219534871435000, end_id=1719219534871435001) [2024-06-24 16:58:54.872291] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] get_max_applied_scn(scn={val:1719219534674993000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:517774431}, palf_committed_end_scn_:{val:1719219534774285002, v:0}, last_check_scn_:{val:1719219534774285002, v:0}, max_applied_cb_scn_:{val:1719219534674993000, v:0}}) [2024-06-24 16:58:54.873666] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.873673] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.873674] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874005] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874047] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874158] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874169] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874184] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874186] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219534873549000, start_id=1719219534873549000, end_id=1719219534873549001) [2024-06-24 16:58:54.874192] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874449] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874509] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874550] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874553] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874663] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874661] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874662] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874667] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.874717] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:54.875020] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107788B-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:54.877400] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1342) [2024-06-24 16:58:54.878164] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107788C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.880909] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=6472, mem_used=81110016) [2024-06-24 16:58:54.880987] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AD9-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.883443] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:54.883495] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:54.883572] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:54.883602] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:54.883602] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2024-06-24 16:58:54.883640] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:54.883669] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:54.883705] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:54.883741] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AE0-0-0] [lt=6][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:54.884051] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=16, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=475, avg_log_submit_to_slide_time=485) [2024-06-24 16:58:54.888778] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.894771] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9AFE-0-0] [lt=6][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:54.912529] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:54.926581] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10778B2-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:54.928228] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10778B4-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219534927372000, start_id=1719219534927372000, end_id=1719219534927372001) [2024-06-24 16:58:54.928343] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10778B4-0-0] [lt=35] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=22, avg_log_batch_cnt=1, total_group_log_size=12208, avg_group_log_size=554) [2024-06-24 16:58:54.928385] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10778B4-0-0] [lt=36] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=12208) [2024-06-24 16:58:54.928468] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9B4F-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:54.928748] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=12208) [2024-06-24 16:58:54.928804] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=12208) [2024-06-24 16:58:54.928843] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=22, avg_log_gen_to_freeze_time=29, avg_log_gen_to_submit_time=38, avg_log_submit_to_flush_time=479, avg_log_submit_to_slide_time=491) [2024-06-24 16:58:54.932849] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219534932632000, start_id=1719219534932632000, end_id=1719219534932632001) [2024-06-24 16:58:54.937156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283454828544, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:54.941913] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043100-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219534941088000, start_id=1719219534941088000, end_id=1719219534941088001) [2024-06-24 16:58:54.957558] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:396) [941][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:54.957702] WDIAG read_multi_row (ob_table_access_helper.h:238) [941][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2024-06-24 16:58:54.959189] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219534959057000, start_id=1719219534959057000, end_id=1719219534959057001) [2024-06-24 16:58:54.964531] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.964810] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=36] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:54.964900] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2024-06-24 16:58:54.976649] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10778D2-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:54.977080] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:54.977117] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:54.977151] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:54.977497] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=409, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:54.977500] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1342) [2024-06-24 16:58:54.977542] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1342) [2024-06-24 16:58:54.977580] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=448, avg_log_submit_to_slide_time=459) [2024-06-24 16:58:54.988836] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:54.997022] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219534996088000, start_id=1719219534996088000, end_id=1719219534996088001) [2024-06-24 16:58:55.003846] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=30] gc stale ls task succ [2024-06-24 16:58:55.011810] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:55.011861] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [963][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=37] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1242) [2024-06-24 16:58:55.019040] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219535018194000, start_id=1719219535018194000, end_id=1719219535018194001) [2024-06-24 16:58:55.025730] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [917][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=19] dump dtl interm result cost(us)(dump_cost=9, ret=0, interm count=0, dump count=621) [2024-06-24 16:58:55.025765] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [917][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=30] clear dtl interm result cost(us)(clear_cost=4, ret=0, gc_.expire_keys_.count()=0, dump count=621, interm count=0, clean count=0) [2024-06-24 16:58:55.036937] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:55.036974] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:55.037004] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=348914515, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:55.041432] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=82900000, replace_num=100000) [2024-06-24 16:58:55.041457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:55.056737] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=33] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:55.063958] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=21] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16519, offset=3764793}, end_cursor:ObLogCursor{file_id=1, log_id=16520, offset=3765066}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d84050, len:3527, log_data_len:273, seq:16519, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:55.064588] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.065707] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219535065704, bytes: 171104847, bw: 0.020358 MB/s, add_ts: 1007616, add_bytes: 21510 [2024-06-24 16:58:55.067676] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:463) [1215][T1004_TeRec][T1004][YB42AC141156-00061B9D9330D90E-0-0] [lt=33] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1719219533872538001, v:0}, new_replayable_scn={val:1719219533872538001, v:0}, new_readable_scn={val:1719219533872538001, v:0}, old_tenant_info={tenant_id:1004, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719219532870164001, v:0}, replayable_scn:{val:1719219532870164001, v:0}, standby_scn:{val:1719219532870164001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1001}}) [2024-06-24 16:58:55.068092] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90E-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1719219535067689000, start_id=1719219535067689000, end_id=1719219535067689001) [2024-06-24 16:58:55.068184] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90E-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7762, avg_group_log_size=646) [2024-06-24 16:58:55.068211] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90E-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7762) [2024-06-24 16:58:55.068578] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7762) [2024-06-24 16:58:55.068638] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7762) [2024-06-24 16:58:55.068677] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=415, avg_log_submit_to_slide_time=427) [2024-06-24 16:58:55.069243] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16520, offset=3765066}, end_cursor:ObLogCursor{file_id=1, log_id=16521, offset=3765331}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d88050, len:3254, log_data_len:265, seq:16520, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:55.069831] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=34] no need to update min/max version(new_version={val:1719219534674993000, v:0}, min_version={val:1719219534674993000, v:0}, max_version={val:1719219534674993000, v:0}) [2024-06-24 16:58:55.071812] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 445.00) [2024-06-24 16:58:55.071848] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:55.072003] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 1.99, rt: 390.00) [2024-06-24 16:58:55.072019] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:55.072053] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072091] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072105] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072119] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072146] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072160] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072174] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072188] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072201] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072215] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072229] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072243] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072257] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.072271] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:55.077122] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] tx gc loop thread is running(MTL_ID()=1004) [2024-06-24 16:58:55.077143] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] try gc retain ctx [2024-06-24 16:58:55.077170] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=11] get_max_applied_scn(scn={val:1719219534874606001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:45097765}, palf_committed_end_scn_:{val:1719219534874606001, v:0}, last_check_scn_:{val:1719219534874606001, v:0}, max_applied_cb_scn_:{val:1719219534874606001, v:0}}) [2024-06-24 16:58:55.077203] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489660, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d7a4d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:55.079584] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=101] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219532870164001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:55.079727] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=117] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:55.079723] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=25] LogLoopThread round_cost_time(us)(round_cost_time=13) [2024-06-24 16:58:55.079751] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:55.082029] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1004, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219532870164001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:55.088895] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.096122] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096124] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096242] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096596] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096758] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096951] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.096953] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097064] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097140] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097143] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097142] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097144] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097270] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097480] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097578] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097676] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097682] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097694] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097689] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097690] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097701] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097698] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097704] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097707] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097711] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097721] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.097730] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098084] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098160] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098179] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098339] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098384] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098387] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098391] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098431] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098442] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098492] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098578] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1337, mem_used=4159488) [2024-06-24 16:58:55.098640] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098645] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098706] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098757] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.098811] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.118195] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:55.118261] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=33] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:55.118284] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2024-06-24 16:58:55.118301] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [358][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=15] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1234) [2024-06-24 16:58:55.133064] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [162968][T1_TenantWeakRe][T1][YB42AC141156-00061B9D89B139A7-0-0] [lt=26] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=189) [2024-06-24 16:58:55.133309] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219535133186000, start_id=1719219535133186000, end_id=1719219535133186001) [2024-06-24 16:58:55.133845] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=419, avg_log_submit_to_slide_time=432) [2024-06-24 16:58:55.135584] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=12] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:55.137651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283450634240, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:55.149432] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9CD5-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:55.152680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077978-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:55.159072] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9CE1-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:55.159308] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219535158568000, start_id=1719219535158568000, end_id=1719219535158568001) [2024-06-24 16:58:55.160398] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=18924644, clean_num=201326) [2024-06-24 16:58:55.162452] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9CE4-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:55.164632] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.165695] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9CE7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:55.166393] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219535165985000, start_id=1719219535165985000, end_id=1719219535165985001) [2024-06-24 16:58:55.166721] WDIAG [STORAGE.TRANS] check_double_insert_ (ob_mvcc_row.cpp:930) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=27][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f46b468e7b8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:82135} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1719215152848208 type=0 flag=0 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:4}, prev=this=0x7f46b77eaee8 trans_version={val:1719219525163171000, v:0} scn={val:1719219525163171000, v:0} tx_id={txid:82030} prev=0x7f46b84f23d8 next=(nil) modify_count=875 acc_checksum=3157881214 version=1719215152848208 type=1 flag=12 snapshot_barrier=4611686018427387803 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:7}, snapshot_version={val:1719219535165985000, v:0}, *this={this=0x7f47339376b0 latch_=locked flag=11 first_dml=DELETE last_dml=INSERT update_since_compact=0 list_head=0x7f46b77eaee8 latest_compact_node=0x7f46b77eaee8 max_trans_version={val:1719219525163171000, v:0} max_trans_id=82030 max_elr_trans_version={val:1719219525163171000, v:0} max_elr_trans_id=82030 latest_compact_ts=1719219525163805 last_compact_cnt=875 total_trans_node_cnt=876 max_modify_scn={val:1719219525163171000, v:0} min_modify_scn={val:1719215152848421000, v:0}}) [2024-06-24 16:58:55.166813] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:972) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=90][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f46b468e7b8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:82135} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1719215152848208 type=0 flag=0 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:160} seq_no={branch:0, seq:4}, ctx={this:0x7f4765ecce80, ls_id:{id:1001}, ls:0x7f47366f8150, branch:0, timeout:1719219545066264, tablet_id:{id:200142}, table_iter:0x7f4765ecc150, table_version:1719213404545896, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1719219545066264, tx_lock_timeout_us:-1, snapshot:{version:{val:1719219535165985000, v:0}, tx_id:{txid:82135}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f4736706990, epoch:1, mini_cache_:}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:82135}, tx_desc:{this:0x7f47a206e110, tx_id:{txid:82135}, state:1, addr:"172.20.17.86:2882", tenant_id:1002, session_id:3221487738, assoc_session_id:3221487738, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1719219535164927, active_ts:1719219535165985, commit_ts:-1, finish_ts:-1, timeout_us:86400000000, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1719213093, cluster_version:17180066048, seq_base:1719219535095146, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:true, cflict_txs:[], abort_cause:0, commit_expire_ts:-1, commit_task_.is_registered():false, ref:2}, tx_ctx:0x7f47a7dbf2d0, mem_ctx:0x7f47a7dc0850, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false}) [2024-06-24 16:58:55.166962] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:339) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=147][errcode=-5024] mvcc write failed(ret=-5024, mem_ctx={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:82135} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}, arg={tx_id:{txid:82135}, data:0x7f4765ec9238, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1719215152848208, seq_no:{branch:0, seq:4}, scn:{val:4611686018427387903, v:0}, column_cnt:8}) [2024-06-24 16:58:55.167012] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:323) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=49][errcode=0] primary key duplication conflict(key={"VARCHAR":"172.20.17.86:5433", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:82135} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2024-06-24 16:58:55.167054] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:3838) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=38][errcode=-5024] fail to set memtable(ret=-5024) [2024-06-24 16:58:55.167069] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5375) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=11][errcode=-5024] failed to write table row(ret=-5024, table id=500310, col_descs=[cnt:8, column_id=16 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=17 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=18 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=19 {type:"TINYINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=20 {type:"TINYINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=22 {type:"DATETIME", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"DATETIME", collation:"binary", coercibility:"NUMERIC"} order=0], tbl_row={flag:"INSERT", flag_type:0} capacity_=0 is_get=0 from_base=0 trans_id=8217090173679840641 scan_index=0 multi_version_row_flag=0 {first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0} row_val={count=8,cells=[{"VARCHAR":"172.20.17.86:5433", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"VARCHAR":"7513a2bb6f", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"VARCHAR":"265c81f5a4bed7cc05ac37c8bcf81170d86650be6b28644a344f4f45f2dd7aa7", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"TINYINT":1},{"TINYINT":0},{"VARCHAR":"4.3.0-20240617185317", collation:"utf8mb4_general_ci", coercibility:"INVALID"},{"DATETIME":"2024-06-24 16:58:55.000000"},{"DATETIME":"2024-06-24 16:58:55.000000"},] is_sparse_row=0 snapshot_version=0 fast_filtered=0 group_idx_=0 last_purge_ts=0 ) [2024-06-24 16:58:55.167194] INFO [STORAGE] print_count (ob_query_iterator_factory.cpp:50) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=91] ObQueryIteratorFactory statistics(multi_scan_merge_alloc_count=0, multi_scan_merge_release_count=0, multi_get_merge_alloc_count=0, multi_get_merge_release_count=0, table_scan_alloc_count=0, table_scan_release_count=0, insert_dup_alloc_count=8922, insert_dup_release_count=8922, col_map_alloc_count=0, col_map_release_count=0) [2024-06-24 16:58:55.167235] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:2923) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=25][errcode=-5024] failed to write row(ret=-5024) [2024-06-24 16:58:55.167293] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:851) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107798D-0-0] [lt=14] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1719213404545896 max_table_version=1719213404545896 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:82135} ls_id=1001 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 need_merge=0 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2024-06-24 16:58:55.171912] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219535171284000, start_id=1719219535171284000, end_id=1719219535171284001) [2024-06-24 16:58:55.176728] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=23] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:55.177242] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=86] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1211) [2024-06-24 16:58:55.177635] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:55.177659] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:55.177685] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=446, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:55.177703] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:55.177729] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1211) [2024-06-24 16:58:55.177754] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=451, avg_log_submit_to_slide_time=460) [2024-06-24 16:58:55.180743] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EB-0-0] [lt=12] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:55.180762] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EB-0-0] [lt=17] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:55.181480] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D906-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:55.181514] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D906-0-0] [lt=32] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:55.188991] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:55.189015] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:55.189029] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.193092] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9D02-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:55.196317] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9D05-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:55.197067] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219535196546000, start_id=1719219535196546000, end_id=1719219535196546001) [2024-06-24 16:58:55.201230] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C0-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:55.202532] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:55.204110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:55.204214] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:55.204425] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:55.204491] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:55.204680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:55.204757] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:55.204860] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10779C3-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:55.217604] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9D26-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:55.219151] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219535218637000, start_id=1719219535218637000, end_id=1719219535218637001) [2024-06-24 16:58:55.219736] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213328633146, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:55.233928] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [803][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:55.241541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:55.244585] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [939][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=37] report RowHolderMapper summary info(count=2620, bkt_cnt=7836) [2024-06-24 16:58:55.247438] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2024-06-24 16:58:55.247495] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=28] get_max_applied_scn(scn={val:1719219535158568000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:73679501}, palf_committed_end_scn_:{val:1719219535196546000, v:0}, last_check_scn_:{val:1719219535196546000, v:0}, max_applied_cb_scn_:{val:1719219535158568000, v:0}}) [2024-06-24 16:58:55.247530] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216956963498, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46f1dc34b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:55.249022] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:55.249060] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:55.249473] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:55.249495] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=448, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:55.249509] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=30, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:55.249744] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=111] succ to get rec scn(*this={this:0x7f46f0604030, ls_id:{id:1}, tenant_id:1003, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216321111181000, v:0}, last_push_gc_task_ts_:1719216953731290, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:55.249779] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=34] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46f1df0080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216953736744, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46f1df0080, snapshot_version:{val:1719216953736744, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:55.249821] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=35] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:55.249967] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=24] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:55.250078] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=105] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46f1d8d790}, min_rec_scn={val:1719216953754927000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:55.250106] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:55.250129] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1719219527861214001, v:0}) [2024-06-24 16:58:55.250142] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:55.250162] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:55.250183] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216953754927000, v:0}, checkpoint_scn_in_ls_meta={val:1719216953754927000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:55.250212] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:55.250235] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:55.250251] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1600][T1003_TxCkpt][T1003][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:55.253650] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:55.253696] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=34] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:55.253718] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [962][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1241) [2024-06-24 16:58:55.259082] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9D57-0-0] [lt=44][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:55.262020] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9D5A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:55.264690] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.284399] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=109] tx gc loop thread is running(MTL_ID()=1003) [2024-06-24 16:58:55.284432] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=32] try gc retain ctx [2024-06-24 16:58:55.286737] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [1618][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=14] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1003, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:55.289011] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.295845] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=20] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=528437248, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=545304576, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:55.296064] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=48] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:55.296092] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:55.296162] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1585602560, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5930590208, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:55.296270] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=34] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:55.296290] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=417405, drift_size_=0, pre_drift_size=30600560, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:55.296353] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:55.296523] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:55.296543] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:55.296614] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=20] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:55.296830] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=48] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:55.296849] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:55.297641] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=19] dump dtl interm result cost(us)(dump_cost=3763, ret=0, interm count=0, dump count=618) [2024-06-24 16:58:55.300871] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [1301][T1004_TntShared][T1004][Y0-0000000000000000-0-0] [lt=35] clear dtl interm result cost(us)(clear_cost=3193, ret=0, gc_.expire_keys_.count()=0, dump count=618, interm count=0, clean count=0) [2024-06-24 16:58:55.302103] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:55.302142] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:55.302170] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=70439748, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:55.307379] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [348][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:55.307589] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BE-0-0] [lt=27] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219532369490003, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:55.307793] INFO [MDS] flush (mds_table_mgr.cpp:172) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BE-0-0] [lt=132] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219532369490003, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:55.307891] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [348][T1002_Flush][T1002][YB42AC141156-00061B9D9090C5BE-0-0] [lt=95] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:55.316995] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0431E9-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:55.327966] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112598, mem_used=264127488) [2024-06-24 16:58:55.332383] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:397) [162151][ServerTracerTim][T0][YB42AC141156-00061B9D86E0C5CE-0-0] [lt=28] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2024-06-24 16:58:55.333377] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219535332380000, start_id=1719219535332380000, end_id=1719219535332380001) [2024-06-24 16:58:55.334096] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0431F7-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219535333433000, start_id=1719219535333433000, end_id=1719219535333433001) [2024-06-24 16:58:55.334604] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=17] ====== tenant freeze timer task ====== [2024-06-24 16:58:55.335009] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD1F8-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219535334487000, start_id=1719219535334487000, end_id=1719219535334487001) [2024-06-24 16:58:55.340439] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9DD2-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219535339733000, start_id=1719219535339733000, end_id=1719219535339733001) [2024-06-24 16:58:55.344866] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=28] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:55.359355] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138C4-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336819486618041992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.884401192498512501e+01) [2024-06-24 16:58:55.359544] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1719219535358685000, start_id=1719219535358685000, end_id=1719219535358685001) [2024-06-24 16:58:55.360177] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [WRS] update tenant weak read server version(tenant_id=1003, server_version={version:{val:1719219535196546000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1719219535360152}, version_delta=163630) [2024-06-24 16:58:55.360893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283450634240, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:55.364749] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.365976] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=31] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:55.371520] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219535371329000, start_id=1719219535371329000, end_id=1719219535371329001) [2024-06-24 16:58:55.375011] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219535374491000, start_id=1719219535374491000, end_id=1719219535374491001) [2024-06-24 16:58:55.375054] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:55.376832] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [960][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:55.377019] INFO [MDS] flush (mds_table_mgr.cpp:172) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BE-0-0] [lt=32] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219547830421000, latest_log_ts:{val:1719219531216126001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:55.377150] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [960][T1001_Flush][T1001][YB42AC141156-00061B9D90C0C5BE-0-0] [lt=126] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:55.377374] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:55.377407] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:55.383881] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:55.383919] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:55.384327] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=397, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:55.384356] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=976) [2024-06-24 16:58:55.384381] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:55.384415] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=7, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:55.384443] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=467, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:55.384461] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=32, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:55.389070] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.397149] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219535396601000, start_id=1719219535396601000, end_id=1719219535396601001) [2024-06-24 16:58:55.419272] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219535418744000, start_id=1719219535418744000, end_id=1719219535418744001) [2024-06-24 16:58:55.422661] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129983, mem_used=326519808) [2024-06-24 16:58:55.435873] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2024-06-24 16:58:55.437546] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [912][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219535436717000, start_id=1719219535436717000, end_id=1719219535436717001) [2024-06-24 16:58:55.437997] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=3340256, this={dio_aligned_buf:{buf_write_offset:2562, buf_padding_size:1534, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:115273, truncate_used_ts:30560}, log_block_size:67108864, dir_fd:667, io_fd:668}, aligned_buf_len=4096, aligned_block_offset=3338240, buf_len=546, total_write_size_=85525, total_write_size_after_dio_=761856, ob_pwrite_used_ts=59685, count=165, each_pwrite_cost=361) [2024-06-24 16:58:55.439427] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=30] run rewrite rule refresh task(rule_mgr_->tenant_id_=1003) [2024-06-24 16:58:55.441465] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1554][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219535440945000, start_id=1719219535440945000, end_id=1719219535440945001) [2024-06-24 16:58:55.441663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:55.441912] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=6580119, this={dio_aligned_buf:{buf_write_offset:2489, buf_padding_size:1607, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:132700, truncate_used_ts:33131}, log_block_size:67108864, dir_fd:682, io_fd:683}, aligned_buf_len=4096, aligned_block_offset=6578176, buf_len=546, total_write_size_=81038, total_write_size_after_dio_=610304, ob_pwrite_used_ts=50135, count=129, each_pwrite_cost=388) [2024-06-24 16:58:55.464088] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B7-0-0] [lt=52][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:55.464120] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B7-0-0] [lt=31][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:55.464808] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.472260] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=30] run rewrite rule refresh task(rule_mgr_->tenant_id_=1004) [2024-06-24 16:58:55.474532] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1297][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219535473632000, start_id=1719219535473632000, end_id=1719219535473632001) [2024-06-24 16:58:55.482887] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:55.483947] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=1, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:55.483983] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:55.484345] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=408, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:55.484375] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:55.484391] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:55.484412] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=494, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:55.484428] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=24, stat_interval=1000000, avg (count/cost)=21, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:55.488918] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9E91-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:55.489128] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.492017] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9E93-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:55.497902] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077B25-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:55.500783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EA0-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:55.502736] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=30] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2024-06-24 16:58:55.503517] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1364][T1004_LCLSender][T1004][Y0-0000000000000000-0-0] [lt=32] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47231fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:55.503700] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EA2-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:55.505017] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163800][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219535504164000, start_id=1719219535504164000, end_id=1719219535504164001) [2024-06-24 16:58:55.505532] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9C8BD1FA-0-0] [lt=11] [APPLY STAT CB APPEND COST TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=41, this=0x7f4753d24280, extra_info="") [2024-06-24 16:58:55.505562] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9C8BD1FA-0-0] [lt=29] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=422, this=0x7f4753d244b0, extra_info="") [2024-06-24 16:58:55.505579] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9C8BD1FA-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=0, this=0x7f4753d246e0, extra_info="") [2024-06-24 16:58:55.505594] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9C8BD1FA-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=-420, this=0x7f4753d24910, extra_info="") [2024-06-24 16:58:55.505608] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9D9C8BD1FA-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=43, this=0x7f4753d24b40, extra_info="") [2024-06-24 16:58:55.529127] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EC4-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:55.531425] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1719219535332380000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199038, in_cluster_service=true, cluster_version={val:1719219535133186000, v:0}, min_cluster_version={val:1719219535133186000, v:0}, max_cluster_version={val:1719219535133186000, v:0}, get_cluster_version_err=0, cluster_version_delta=398232, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60665, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219313404268000, v:0}, local_cluster_delta=222127150, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:55.532332] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077B4F-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4794, pos=2788, bitmap=NULL) [2024-06-24 16:58:55.533462] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219535532670000, start_id=1719219535532670000, end_id=1719219535532670001) [2024-06-24 16:58:55.534358] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3413) [2024-06-24 16:58:55.534404] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3413) [2024-06-24 16:58:55.534586] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219535332380000, v:0}, new_max_version={val:1719219535332380000, v:0}, last_min_version={val:1719219535133186000, v:0}, last_max_version={val:1719219535133186000, v:0}, total_time_us=3091, delta_us=202205) [2024-06-24 16:58:55.537439] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077B51-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:55.540352] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:55.540458] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:55.540663] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:55.540728] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:55.540885] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:55.540958] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:55.541055] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EDA-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:55.553072] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9EED-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:55.559707] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219535559036000, start_id=1719219535559036000, end_id=1719219535559036001) [2024-06-24 16:58:55.560313] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219535358685000, v:0}, min_version={val:1719219535358685000, v:0}, max_version={val:1719219535358685000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:55.560359] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] get wrs ts(ls_id={id:1}, delta=119149, log_service_ts=1719219535440945, min_tx_service_ts=4611686018427387, timestamp={val:1719219535440945000, v:0}) [2024-06-24 16:58:55.560382] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:214) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=18] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1003, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=98, Other_Error_Cnt=0, Submit_Succ_Cnt=2, last_scn="{val:1719219535196546001, v:0}", last_lsn={lsn:73679557}, last_gts={val:1719219535440945000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2024-06-24 16:58:55.561369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283446439936, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:55.564868] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.567016] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2024-06-24 16:58:55.569085] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162918][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219535568550000, start_id=1719219535568550000, end_id=1719219535568550001) [2024-06-24 16:58:55.569540] INFO [PALF] inner_write_once_ (log_block_handler.cpp:411) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=53536254, this={dio_aligned_buf:{buf_write_offset:2079, buf_padding_size:2017, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:90036, truncate_used_ts:24260}, log_block_size:67108864, dir_fd:658, io_fd:660}, aligned_buf_len=4096, aligned_block_offset=53534720, buf_len=545, total_write_size_=38072, total_write_size_after_dio_=430080, ob_pwrite_used_ts=39076, count=96, each_pwrite_cost=407) [2024-06-24 16:58:55.572042] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1719219535571686000, start_id=1719219535571686000, end_id=1719219535571686001) [2024-06-24 16:58:55.572125] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:55.572155] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:55.572535] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=365, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:55.572568] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=13, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:55.572591] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:55.572610] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=421, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:55.572642] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=21, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:55.580051] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:99449, max_lsn:73681925, max_scn:{val:1719219535559036000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:73681925}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:31738885}}, last_submit_lsn:{lsn:73681337}, last_submit_end_lsn:{lsn:73681925}, last_submit_log_id:99449, last_submit_log_pid:1, max_flushed_lsn:{lsn:73681337}, max_flushed_end_lsn:{lsn:73681925}, max_flushed_log_pid:1, committed_end_lsn:{lsn:73681925}, last_slide_log_id:99449, last_slide_scn:{val:1719219535559036000, v:0}, last_slide_lsn:{lsn:73681337}, last_slide_end_lsn:{lsn:73681925}, last_slide_log_pid:1, last_slide_log_accum_checksum:790254812, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46f1dbc530}, [StateMgr]={this:0x7f46f1dc02b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:99450, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213354015462, palf_role_change_cb:0x7f46f1dc6cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46f1dbdc70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1003/1/meta", dir_fd:681, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46f1dc2478, flashback_version:0}, log_storage:{log_tail:{lsn:73681925}, readable_log_tail:{lsn:73681925}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719218755426586001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1003/1/log", dir_fd:682, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:60527611, block_header_serialize_buf_:0x7f46f1dc4138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213354015379, this:0x7f46f1dc09f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213354015961, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46f1dc0430}) [2024-06-24 16:58:55.580414] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=357] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219535560197, last_flushed_end_lsn:{lsn:73681925}}]) [2024-06-24 16:58:55.580443] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1464][T1003_LogLoop][T1003][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=99450, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219535560197, last_flushed_end_lsn:{lsn:73681925}}]) [2024-06-24 16:58:55.585916] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9F25-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:55.588798] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077B84-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4804, pos=2778, bitmap=NULL) [2024-06-24 16:58:55.589187] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.596492] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077B8B-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219535595990000, start_id=1719219535595990000, end_id=1719219535595990001) [2024-06-24 16:58:55.597302] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219535597047000, start_id=1719219535597047000, end_id=1719219535597047001) [2024-06-24 16:58:55.601421] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0432B1-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=224, pos=203, bitmap=NULL) [2024-06-24 16:58:55.601944] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0432B1-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=108, pos=82, bitmap=NULL) [2024-06-24 16:58:55.602290] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0432B1-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=402, pos=376, bitmap=NULL) [2024-06-24 16:58:55.602560] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0432B1-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=12, len=656, pos=627, bitmap=NULL) [2024-06-24 16:58:55.602850] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0432B1-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=8, len=244, pos=77, bitmap=NULL) [2024-06-24 16:58:55.603326] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0432B1-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=13, len=155, pos=109, bitmap=NULL) [2024-06-24 16:58:55.603992] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [162977][T1_ArcSender][T1][YB42AC141156-00061B9D8760C0E5-0-0] [lt=29][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:55.607199] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=11] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1003) [2024-06-24 16:58:55.607249] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1003, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:55.607275] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1003, cache_evict_num=0, mem_hold=62914560, mem_limit=85899345, cache_obj_num=144, cache_node_num=144) [2024-06-24 16:58:55.607296] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:55.612768] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] [COMPACTION DAG STATUS] (start_time=1719219525610672, end_time=1719219535612766, dag_status={}) [2024-06-24 16:58:55.612800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612817] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612844] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612868] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612880] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612893] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612907] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:55.612920] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.612937] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.612951] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.612962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.612976] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.612990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613004] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613020] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613034] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613047] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613061] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613075] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613089] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613113] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613127] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613143] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613156] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613170] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613184] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613197] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613225] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613239] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613255] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613268] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613295] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613309] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613336] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613350] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613365] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613379] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613390] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613404] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613418] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613431] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613445] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613459] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613472] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613488] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613502] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613515] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613529] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613553] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613580] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613596] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613609] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613640] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613654] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613668] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613682] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613693] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613707] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:55.613738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:55.613751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:55.613763] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:55.613771] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:55.613782] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:55.613789] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:55.613799] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:55.613805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=6] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:55.613815] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:55.613822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=7] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:55.613833] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [1548][T1003_DagSchedu][T1003][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:55.614515] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=144, alloc_obj_list=[{obj_id:6, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:7, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:182, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:183, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:195, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:196, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195296}, {obj_id:199, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198764}, {obj_id:232, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197576}, {obj_id:237, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:238, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:242, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:246, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:248, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:250, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:251, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:252, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:253, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:254, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:255, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:256, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190960}, {obj_id:257, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:258, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:259, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:265, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:267, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193914}, {obj_id:268, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:269, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:270, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:271, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:273, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245001}, {obj_id:274, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238477}, {obj_id:278, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303661}, {obj_id:280, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250140}, {obj_id:282, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265464}, {obj_id:283, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260287}, {obj_id:285, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:286, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:287, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:288, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:289, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:290, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:291, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:292, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:293, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:294, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:296, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:297, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:298, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:299, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:300, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:302, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:306, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:307, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:308, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:310, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:311, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:313, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:314, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:315, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192384}, {obj_id:316, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:317, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:318, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179373}, {obj_id:319, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:320, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:321, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:322, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214835}, {obj_id:323, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257749}, {obj_id:324, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257679}, {obj_id:325, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:301211}, {obj_id:326, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:322954}, {obj_id:327, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255184}, {obj_id:328, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253823}, {obj_id:329, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:326827}, {obj_id:330, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262876}, {obj_id:331, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283304}, {obj_id:332, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296168}, {obj_id:333, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:261538}, {obj_id:334, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:285869}, {obj_id:335, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300008}, {obj_id:336, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183813}, {obj_id:337, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215145}, {obj_id:338, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252630}, {obj_id:339, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273088}, {obj_id:340, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280836}, {obj_id:341, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275631}, {obj_id:342, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:284691}, {obj_id:343, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250120}, {obj_id:344, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246226}, {obj_id:345, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247565}, {obj_id:346, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242359}, {obj_id:347, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:348, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:349, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:350, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:351, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265421}, {obj_id:352, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269241}, {obj_id:353, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270506}, {obj_id:354, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276928}, {obj_id:355, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267956}, {obj_id:356, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273080}, {obj_id:357, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280749}, {obj_id:358, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292309}, {obj_id:359, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278185}, {obj_id:360, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288460}, {obj_id:361, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288428}, {obj_id:362, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:303857}, {obj_id:363, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:364, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:365, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:366, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:367, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:368, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:369, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419863}, {obj_id:371, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312858}, {obj_id:372, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417607}, {obj_id:373, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:374, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:375, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:376, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:377, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:378, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:379, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:380, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:384, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:385, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200158}, {obj_id:386, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332258}, {obj_id:387, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:388, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:434, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187881}, {obj_id:435, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269004}, {obj_id:436, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:437, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:500, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297770}, {obj_id:686, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175750}, {obj_id:687, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189803}, {obj_id:688, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465848}, {obj_id:689, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461380}, {obj_id:690, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:352652}, {obj_id:691, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:850328}, {obj_id:692, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195368}, {obj_id:693, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276678}, {obj_id:694, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:695, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272832}, {obj_id:696, tenant_id:1003, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242168}]) [2024-06-24 16:58:55.615087] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1489][T1003_PlanCache][T1003][Y0-0000000000000000-0-0] [lt=568] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:55.619354] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219535619201000, start_id=1719219535619201000, end_id=1719219535619201001) [2024-06-24 16:58:55.622022] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:55.622299] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=17] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:55.624531] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13A9F7B-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:55.641750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:55.647890] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC42-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103431739255, cache_obj->added_lc()=false, cache_obj->get_object_id()=9381, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:55.657929] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1003, server_version={version:{val:1719219535440945000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=216977, in_cluster_service=true, cluster_version={val:1719219535358685000, v:0}, min_cluster_version={val:1719219535358685000, v:0}, max_cluster_version={val:1719219535358685000, v:0}, get_cluster_version_err=0, cluster_version_delta=299237, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60062, succ_cluster_heartbeat_count=9, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219471621660000, v:0}, local_cluster_delta=64036262, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:55.664931] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.677956] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=402, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:55.677993] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:55.678007] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:55.678034] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=485, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:55.678051] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=23, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:55.689244] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.693695] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=22] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2024-06-24 16:58:55.693853] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=31] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=375809635, ret=0) [2024-06-24 16:58:55.693987] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=17] set tenant work area memory(tenant_id=1003, wa_pctg=5, limit=157286400, ret=0) [2024-06-24 16:58:55.694126] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=18] set tenant work area memory(tenant_id=1004, wa_pctg=5, limit=773094110, ret=0) [2024-06-24 16:58:55.701042] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=26] gc stale ls task succ [2024-06-24 16:58:55.702984] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219535702980, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-06-24 16:58:55.707249] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=25] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13768, offset=3458586}, end_cursor:ObLogCursor{file_id=1, log_id=13769, offset=3458859}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d8c050, len:2534, log_data_len:273, seq:13768, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:55.710530] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:463) [163725][T1002_TeRec][T1002][YB42AC141156-00061B9D8CC0D91E-0-0] [lt=33] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=3136000, MAX_GAP=900000000000, new_sync_scn={val:1719219534674993000, v:0}, new_replayable_scn={val:1719219534674993000, v:0}, new_readable_scn={val:1719219534671857000, v:0}, old_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719219533370815002, v:0}, replayable_scn:{val:1719219533370815002, v:0}, standby_scn:{val:1719219533370815001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1001}}) [2024-06-24 16:58:55.710918] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91E-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1719219535710895000, start_id=1719219535710895000, end_id=1719219535710895001) [2024-06-24 16:58:55.711011] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91E-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7853, avg_group_log_size=604) [2024-06-24 16:58:55.711039] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91E-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7853) [2024-06-24 16:58:55.711386] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7853) [2024-06-24 16:58:55.711441] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7853) [2024-06-24 16:58:55.711479] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=407, avg_log_submit_to_slide_time=416) [2024-06-24 16:58:55.712033] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=21] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13769, offset=3458859}, end_cursor:ObLogCursor{file_id=1, log_id=13770, offset=3459124}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d94050, len:2261, log_data_len:265, seq:13769, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:55.717477] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1719219535436717000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=280755, in_cluster_service=true, cluster_version={val:1719219535418744000, v:0}, min_cluster_version={val:1719219535418744000, v:0}, max_cluster_version={val:1719219535418744000, v:0}, get_cluster_version_err=0, cluster_version_delta=298728, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60353, succ_cluster_heartbeat_count=10, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219444964826000, v:0}, local_cluster_delta=90752646, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:55.723753] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:55.723786] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:55.723815] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=103095666, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:55.731581] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=22] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:55.732786] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=13] ====== tenant freeze timer task ====== [2024-06-24 16:58:55.733219] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219535733001000, start_id=1719219535733001000, end_id=1719219535733001001) [2024-06-24 16:58:55.733712] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=430, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:55.733758] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=17, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:55.746236] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=16] === Run print tenant memory usage task === [2024-06-24 16:58:55.746334] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=20] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 288,169,984 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 2,043,682,816 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 42,557,440 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 25,780,224 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,719,219,535,745,629 active_memstore_used= 136,314,880 total_memstore_used= 136,314,880 total_memstore_hold= 136,314,880 memstore_freeze_trigger_limit= 1,825,361,100 memstore_limit= 9,126,805,500 mem_tenant_limit= 18,253,611,008 mem_tenant_hold= 1,576,955,904 max_mem_memstore_can_get_now= 14,898,270,208 memstore_alloc_pos= 192,937,984 memstore_frozen_pos= 56,623,104 memstore_reclaimed_pos= 56,623,104 [TENANT_MEMORY] tenant_id= 1,001 now= 1,719,219,535,745,629 active_memstore_used= 46,137,344 total_memstore_used= 46,137,344 total_memstore_hold= 46,137,344 memstore_freeze_trigger_limit= 66,274,500 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 528,437,248 max_mem_memstore_can_get_now= 331,372,544 memstore_alloc_pos= 96,468,992 memstore_frozen_pos= 50,331,648 memstore_reclaimed_pos= 50,331,648 [TENANT_MEMORY] tenant_id= 1,002 now= 1,719,219,535,745,629 active_memstore_used= 421,527,552 total_memstore_used= 421,527,552 total_memstore_hold= 421,527,552 memstore_freeze_trigger_limit= 601,295,400 memstore_limit= 3,006,477,080 mem_tenant_limit= 7,516,192,768 mem_tenant_hold= 1,587,699,712 max_mem_memstore_can_get_now= 4,252,868,608 memstore_alloc_pos= 723,517,440 memstore_frozen_pos= 301,989,888 memstore_reclaimed_pos= 301,989,888 [TENANT_MEMORY] tenant_id= 1,003 now= 1,719,219,535,745,629 active_memstore_used= 46,137,344 total_memstore_used= 46,137,344 total_memstore_hold= 46,137,344 memstore_freeze_trigger_limit= 117,442,300 memstore_limit= 687,194,760 mem_tenant_limit= 1,717,986,918 mem_tenant_hold= 669,392,896 max_mem_memstore_can_get_now= 587,211,544 memstore_alloc_pos= 104,857,600 memstore_frozen_pos= 58,720,256 memstore_reclaimed_pos= 58,720,256 [TENANT_MEMORY] tenant_id= 1,004 now= 1,719,219,535,745,629 active_memstore_used= 199,229,440 total_memstore_used= 199,229,440 total_memstore_hold= 199,229,440 memstore_freeze_trigger_limit= 1,546,188,220 memstore_limit= 7,730,941,100 mem_tenant_limit= 15,461,882,266 mem_tenant_hold= 1,612,541,952 max_mem_memstore_can_get_now= 11,945,126,298 memstore_alloc_pos= 255,852,544 memstore_frozen_pos= 56,623,104 memstore_reclaimed_pos= 56,623,104 [2024-06-24 16:58:55.746584] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=46] [CHUNK_MGR] limit=296,352,743,424 hold= 8,501,202,944 total_hold= 8,826,912,768 used= 8,082,853,888 freelists_hold= 418,349,056 total_maps= 3,049 total_unmaps= 98 large_maps= 195 large_unmaps= 0 huge_maps= 32 huge_unmaps= 8 memalign=0 resident_size= 8,141,840,384 virtual_memory_used= 9,925,324,800 [CHUNK_MGR] 2 MB_CACHE: hold= 299,892,736 free= 143 pushes= 16,198,761 pops= 16,198,618 maps= 2,822 unmaps= 90 [CHUNK_MGR] 4 MB_CACHE: hold= 38,621,184 free= 17 pushes= 11,703 pops= 11,686 maps= 126 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 0 free= 0 pushes= 45 pops= 45 maps= 18 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 10,393 pops= 10,391 maps= 10 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 16,818,176 free= 2 pushes= 12 pops= 10 maps= 29 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 50,393,088 free= 3 pushes= 8 pops= 5 maps= 9 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [2024-06-24 16:58:55.746816] INFO print (ob_malloc_time_monitor.cpp:39) [162148][ServerGTimer][T0][YB42AC141156-00061B9D9CD222A2-0-0] [lt=17] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 0, 10): delta_total_cost_time= 580834, delta_count= 688079, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10, 100): delta_total_cost_time= 31979, delta_count= 1271, avg_cost_time= 25 [MALLOC_TIME_MONITOR] [ 100, 1000): delta_total_cost_time= 4289, delta_count= 36, avg_cost_time= 119 [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 12149, delta_count= 3, avg_cost_time= 4049 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2024-06-24 16:58:55.759795] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219535759312000, start_id=1719219535759312000, end_id=1719219535759312001) [2024-06-24 16:58:55.761869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283446439936, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:55.764991] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.767153] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=28] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:55.772146] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219535771992000, start_id=1719219535771992000, end_id=1719219535771992001) [2024-06-24 16:58:55.778836] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C54-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:55.781755] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA066-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:55.784571] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1522) [2024-06-24 16:58:55.787007] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA06A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:55.789304] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.789808] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA06D-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:55.792591] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA06F-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:55.797378] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219535796327000, start_id=1719219535796327000, end_id=1719219535796327001) [2024-06-24 16:58:55.797454] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:55.797492] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:55.797864] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=374, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:55.797901] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=14, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:55.797933] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:55.797959] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=443, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:55.797976] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=29, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:55.797975] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=5] [APPLY STAT CB APPEND COST TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=33, this=0x7f46f1dd4280, extra_info="") [2024-06-24 16:58:55.798005] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=417, this=0x7f46f1dd44b0, extra_info="") [2024-06-24 16:58:55.798020] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=0, this=0x7f46f1dd46e0, extra_info="") [2024-06-24 16:58:55.798034] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=-449, this=0x7f46f1dd4910, extra_info="") [2024-06-24 16:58:55.798047] INFO [LIB] stat (utility.h:1165) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=1, this=0x7f46f1dd4b40, extra_info="") [2024-06-24 16:58:55.817413] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA089-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:55.819492] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219535818535000, start_id=1719219535818535000, end_id=1719219535818535001) [2024-06-24 16:58:55.820315] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA08B-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:55.825072] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C97-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:55.826032] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [162835][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=22] LogLoopThread round_cost_time(us)(round_cost_time=25) [2024-06-24 16:58:55.826922] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=24] new mysql sessid created(conn.sessid_=3221494487, support_ssl=false) [2024-06-24 16:58:55.827000] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] sm conn init succ(conn.sessid_=3221494487, sess.client_addr_="172.20.17.86:49544") [2024-06-24 16:58:55.827023] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f47833c2030, session_id:3221494487, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:55.827099] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494487, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:55.827131] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=27] kill and revert session(conn.sessid_=3221494487, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:55.827148] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494487, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:55.827174] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=25] mark session id unused(conn.sessid_=3221494487) [2024-06-24 16:58:55.827187] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162491][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494487, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:55.827921] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:55.828029] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:55.828238] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:55.828305] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:55.828375] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=20] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=36, mem_used=49913856) [2024-06-24 16:58:55.828417] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=29] release old cannot free more memory [2024-06-24 16:58:55.828432] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=58, size_used=0, mem_used=49913856) [2024-06-24 16:58:55.828481] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:55.828561] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:55.828680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077C9A-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:55.840806] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA0AF-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:55.841841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:55.849424] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3836, avg_group_log_size=426) [2024-06-24 16:58:55.849459] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3836) [2024-06-24 16:58:55.857756] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=28] current monitor number(seq_=-1) [2024-06-24 16:58:55.865048] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.870264] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1719219535504164000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=366094, in_cluster_service=true, cluster_version={val:1719219535374491000, v:0}, min_cluster_version={val:1719219535374491000, v:0}, max_cluster_version={val:1719219535374491000, v:0}, get_cluster_version_err=0, cluster_version_delta=495767, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60280, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219385327519000, v:0}, local_cluster_delta=150542739, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:55.873654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.873901] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874035] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874051] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874248] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874241] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874262] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874263] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874294] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874306] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874485] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874495] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874491] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874598] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874600] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874618] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=7] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874666] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874669] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874709] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.874735] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:55.875834] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219535875501000, start_id=1719219535875501000, end_id=1719219535875501001) [2024-06-24 16:58:55.875895] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=388, get_gts_with_stc_cnt=61, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=61, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:55.875937] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=7833, get_gts_with_stc_cnt=46, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=44, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:55.878067] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1089) [2024-06-24 16:58:55.880501] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA0DE-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:55.881043] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=9838, mem_used=89428992) [2024-06-24 16:58:55.883558] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077CD0-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:55.884102] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=8, avg_log_batch_cnt=1, total_group_log_size=1400, avg_group_log_size=175) [2024-06-24 16:58:55.884126] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1400) [2024-06-24 16:58:55.884477] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=8, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=440, avg_log_submit_to_slide_time=450) [2024-06-24 16:58:55.889366] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.889525] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [966][T1001_ArcFetche][T1001][YB42AC141156-00061B9D8DA0C0E5-0-0] [lt=37] ObArchiveFetcher is running(thread_index=0) [2024-06-24 16:58:55.895491] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1004, server_version={version:{val:1719219535473632001, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=421853, in_cluster_service=true, cluster_version={val:1719219535473632000, v:0}, min_cluster_version={val:1719219535473632000, v:0}, max_cluster_version={val:1719219535473632000, v:0}, get_cluster_version_err=0, cluster_version_delta=421853, cluster_service_master="172.20.17.86:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=60105, succ_cluster_heartbeat_count=6, cluster_heartbeat_interval=50000, local_cluster_version={val:1719219412155330001, v:0}, local_cluster_delta=123740155, force_self_check=false, weak_read_refresh_interval=100000) [2024-06-24 16:58:55.912574] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=28] gc stale ls task succ [2024-06-24 16:58:55.933660] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219535933419000, start_id=1719219535933419000, end_id=1719219535933419001) [2024-06-24 16:58:55.935732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA124-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:55.938994] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [162941][T1_RFLWorker][T1][YB42AC141156-00061B9D8700C0E5-0-0] [lt=29] ObRemoteFetchWorker is running(thread_index=0) [2024-06-24 16:58:55.946363] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA137-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219535946028000, start_id=1719219535946028000, end_id=1719219535946028001) [2024-06-24 16:58:55.946455] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA137-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=6002, avg_group_log_size=428) [2024-06-24 16:58:55.946483] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA137-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=6002) [2024-06-24 16:58:55.946843] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=6002) [2024-06-24 16:58:55.946889] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=6002) [2024-06-24 16:58:55.946908] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=420, avg_log_submit_to_slide_time=428) [2024-06-24 16:58:55.959942] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219535959743000, start_id=1719219535959743000, end_id=1719219535959743001) [2024-06-24 16:58:55.962366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283444342784, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:55.965104] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.972278] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] get number(ret=0, service_type_=0, range=1, base_id=1719219535971319000, start_id=1719219535971319000, end_id=1719219535971319001) [2024-06-24 16:58:55.977748] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:55.977791] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:55.977840] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1089, avg_group_log_size=121) [2024-06-24 16:58:55.978160] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=363, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:55.978164] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1635) [2024-06-24 16:58:55.978206] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1089) [2024-06-24 16:58:55.978239] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=401, avg_log_submit_to_slide_time=412) [2024-06-24 16:58:55.988066] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [1586][T1003_LCLSender][T1003][Y0-0000000000000000-0-0] [lt=40] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47041fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:55.989425] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:55.997555] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1719219535996690000, start_id=1719219535996690000, end_id=1719219535996690001) [2024-06-24 16:58:55.998200] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=30] get_max_applied_scn(scn={val:1719219535876558000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:57996998}, palf_committed_end_scn_:{val:1719219535876558001, v:0}, last_check_scn_:{val:1719219535876558001, v:0}, max_applied_cb_scn_:{val:1719219535876558000, v:0}}) [2024-06-24 16:58:55.998257] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=54] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213369678630001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216963489769, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213369678630001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f46d2f8f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:56.003906] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:56.015818] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=10] ====== checkpoint timer task ====== [2024-06-24 16:58:56.015866] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get_max_applied_scn(scn={val:1719219535933419000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:53533995}, palf_committed_end_scn_:{val:1719219535933419000, v:0}, last_check_scn_:{val:1719219535933419000, v:0}, max_applied_cb_scn_:{val:1719219535933419000, v:0}}) [2024-06-24 16:58:56.015899] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216859568487, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47b688f4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:56.017930] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=82] succ to get rec scn(*this={this:0x7f47b3e04030, ls_id:{id:1}, tenant_id:1, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216858758544000, v:0}, last_push_gc_task_ts_:1719216859472314, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1025}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.017961] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=30] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47b6924080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216859475873, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47b6924080, snapshot_version:{val:1719216859475873, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.017997] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=30] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:56.018191] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219548711542000, latest_log_ts:{val:1719219532131098001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:56.018294] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=98] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f47b684c1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f47b685a0d0, memtable_head:3, memtable_tail:4, t3m:0x7f47ded72030, tables:[null, null, null, 0x7f47b6914080, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215058499657, tx_data_table:0x7f47b685bb90, ls_tablet_svr:0x7f47b684c190}, min_rec_scn={val:1719216859633263000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:56.018339] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:56.018358] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=0, rec_log_ts={val:1719219532131098001, v:0}) [2024-06-24 16:58:56.018370] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.018386] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.018416] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=10] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216859633263000, v:0}, checkpoint_scn_in_ls_meta={val:1719216859633263000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:56.018444] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:56.018464] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:56.018478] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [162969][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=12] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:56.019599] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219536018864000, start_id=1719219536018864000, end_id=1719219536018864001) [2024-06-24 16:58:56.041929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:56.049498] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] tx gc loop thread is running(MTL_ID()=1) [2024-06-24 16:58:56.049522] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] try gc retain ctx [2024-06-24 16:58:56.051800] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=12] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219548711542000, latest_log_ts:{val:1719219532131098001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:56.056854] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:56.065161] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.070413] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1719213342229334001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936814158, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1719213342229334001, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f47367374b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1001, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:56.073321] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1719219536073319, bytes: 171124487, bw: 0.018589 MB/s, add_ts: 1007615, add_bytes: 19640 [2024-06-24 16:58:56.073346] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=11] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16521, offset=3765331}, end_cursor:ObLogCursor{file_id=1, log_id=16522, offset=3765604}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d90050, len:2989, log_data_len:273, seq:16521, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:56.074215] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 383.00) [2024-06-24 16:58:56.074247] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:56.074352] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 1.00, rt: 388.00) [2024-06-24 16:58:56.074370] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:56.074407] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074426] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074441] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074455] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074469] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074482] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074493] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074507] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074521] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074537] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074551] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074565] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074579] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074593] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074608] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.074646] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:56.077539] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90F-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219536076958000, start_id=1719219536076958000, end_id=1719219536076958001) [2024-06-24 16:58:56.077651] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90F-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8422, avg_group_log_size=601) [2024-06-24 16:58:56.077680] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D90F-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=8422) [2024-06-24 16:58:56.078064] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=8422) [2024-06-24 16:58:56.078121] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=8422) [2024-06-24 16:58:56.078159] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=411, avg_log_submit_to_slide_time=427) [2024-06-24 16:58:56.078759] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=28] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16522, offset=3765604}, end_cursor:ObLogCursor{file_id=1, log_id=16523, offset=3765869}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d98050, len:2716, log_data_len:265, seq:16522, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:56.089463] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.096519] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096554] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096593] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096660] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096658] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096693] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096774] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096788] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.096934] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097017] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097214] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097275] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097285] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097315] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097339] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097373] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097372] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097555] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097595] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097663] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097673] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097694] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097669] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097718] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097672] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097759] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097749] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097749] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097759] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097787] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.097947] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098014] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098020] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098030] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098047] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098196] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098197] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098196] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098197] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098248] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098321] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098424] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098454] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098614] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098681] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098669] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1372, mem_used=4159488) [2024-06-24 16:58:56.098691] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098701] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098705] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098706] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098714] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.098834] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.107871] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077DDF-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.111316] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077DE1-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.112844] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:56.112872] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=21] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:56.112904] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=73686745, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:56.116827] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163033][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD27-0-0] [lt=37] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:56.116860] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163033][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD27-0-0] [lt=24] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=42) [2024-06-24 16:58:56.117310] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0433FB-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.120706] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0433FC-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.123983] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0433FD-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4801, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.133819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219536133030000, start_id=1719219536133030000, end_id=1719219536133030001) [2024-06-24 16:58:56.134313] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=466, avg_log_submit_to_slide_time=481) [2024-06-24 16:58:56.134373] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=19] [APPLY STAT CB APPEND COST TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=38, this=0x7f47b68f8280, extra_info="") [2024-06-24 16:58:56.134404] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=453, this=0x7f47b68f84b0, extra_info="") [2024-06-24 16:58:56.134421] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=0, this=0x7f47b68f86e0, extra_info="") [2024-06-24 16:58:56.134436] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=-542, this=0x7f47b68f8910, extra_info="") [2024-06-24 16:58:56.134447] INFO [LIB] stat (utility.h:1165) [162993][T1_ApplySrv1][T1][YB42AC141156-00061B9D8820FB66-0-0] [lt=11] [APPLY STAT CB TOTAL TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=-50, this=0x7f47b68f8b40, extra_info="") [2024-06-24 16:58:56.135684] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=12] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:56.144581] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=12] Garbage Collector is running(seq_=622, gc_interval=10000000) [2024-06-24 16:58:56.144672] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=24] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:56.144699] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=14] gc_check_member_list_ cost time(ret=0, time_us=90) [2024-06-24 16:58:56.144713] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=9] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:56.146369] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=14] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:56.146400] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=26] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:56.146418] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] execute_gc cost time(ret=0, time_us=19) [2024-06-24 16:58:56.146431] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2024-06-24 16:58:56.146443] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2024-06-24 16:58:56.146471] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [937][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2024-06-24 16:58:56.149890] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA25C-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.153244] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E0C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:56.158226] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E0E-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:56.160010] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219536159476000, start_id=1719219536159476000, end_id=1719219536159476001) [2024-06-24 16:58:56.161110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:56.161218] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:56.161424] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:56.161491] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:56.161699] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:56.161783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:56.161889] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E11-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:56.162860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283444342784, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:56.165219] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.168411] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=50] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:56.172383] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=107] get number(ret=0, service_type_=0, range=1, base_id=1719219536172167000, start_id=1719219536172167000, end_id=1719219536172167001) [2024-06-24 16:58:56.173896] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA288-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.176832] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=21] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:56.177890] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1766, avg_group_log_size=160) [2024-06-24 16:58:56.177919] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1757) [2024-06-24 16:58:56.177957] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:56.178241] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=12, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:56.178265] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:56.178287] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=417, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:56.178301] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=27, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:56.181702] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EC-0-0] [lt=11] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:56.181721] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EC-0-0] [lt=16] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:56.183400] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D907-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:56.183434] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D907-0-0] [lt=31] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:56.188793] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:174) [163820][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=21] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2024-06-24 16:58:56.188827] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:637) [163820][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=31] finish to resize log external storage handler(current_ts=1719219536188825, tenant_max_cpu=4, valid_ls_count=0, other_ls_count=0, new_concurrency=0) [2024-06-24 16:58:56.189522] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.197669] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=130] get number(ret=0, service_type_=0, range=1, base_id=1719219536197451000, start_id=1719219536197451000, end_id=1719219536197451001) [2024-06-24 16:58:56.202585] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=32] gc stale ls task succ [2024-06-24 16:58:56.214416] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA2C5-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:56.217518] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077E49-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.219707] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219536219627000, start_id=1719219536219627000, end_id=1719219536219627001) [2024-06-24 16:58:56.242016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:56.249662] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=103] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:56.249705] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:56.250104] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=10, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:56.250128] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=496, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:56.250170] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=39, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:56.255212] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1719219526253082, end_time=1719219536255208, dag_status={}) [2024-06-24 16:58:56.255248] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255271] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255287] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255302] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255316] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255330] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255347] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255361] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255375] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:56.255389] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255408] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255424] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255441] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255457] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255489] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255522] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255571] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255603] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255619] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255656] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255673] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255707] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255752] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255784] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255819] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255851] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255867] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255883] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255899] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255916] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255949] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255966] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255983] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.255998] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256015] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256030] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256046] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256062] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256102] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256115] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256155] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256191] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256228] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256263] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256304] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256339] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256374] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256387] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256403] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256419] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256435] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256451] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:56.256487] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:56.256501] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:56.256515] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:56.256524] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=9] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:56.256536] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:56.256545] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:56.256553] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:56.256565] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:56.256573] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=8] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:56.256584] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:56.256595] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [162912][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=9] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:56.265276] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.270550] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA311-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:56.278359] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1766) [2024-06-24 16:58:56.278390] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=453, avg_log_submit_to_slide_time=461) [2024-06-24 16:58:56.285196] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=17] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:56.285233] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=36] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:56.285250] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72C-0-0] [lt=21] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:56.285294] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72C-0-0] [lt=38] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:56.289579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.319309] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] ====== checkpoint timer task ====== [2024-06-24 16:58:56.321470] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] succ to get rec scn(*this={this:0x7f474be04030, ls_id:{id:1}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215719054755000, v:0}, last_push_gc_task_ts_:1719216936767864, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.321509] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=38] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739404080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216936773978, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739404080, snapshot_version:{val:1719216936773978, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.321550] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:56.321694] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f4753c76510, is_inited:true, freezing_scn:{val:1719215120121692000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219533370815002, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:56.321808] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=109] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f4753c761b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f4753c840d0, memtable_head:2, memtable_tail:3, t3m:0x7f4782d1e030, tables:[null, null, 0x7f4753dced90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215135780086, tx_data_table:0x7f4753c85b90, ls_tablet_svr:0x7f4753c76190}, min_rec_scn={val:1719216939041208000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:56.321854] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:56.321875] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=0, rec_log_ts={val:1719219529824381001, v:0}) [2024-06-24 16:58:56.321888] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.321913] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216939041208000, v:0}, checkpoint_scn_in_ls_meta={val:1719216939041208000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:56.321938] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:56.321960] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:56.323885] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] succ to get rec scn(*this={this:0x7f474beb6030, ls_id:{id:1001}, tenant_id:1002, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213748817809002, v:0}, last_push_gc_task_ts_:1719215150704743, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:580}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.323915] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=29] tx ctx memtable get rec scn(this={ObITable:{this:0x7f4739405350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215150709832, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f4739405350, snapshot_version:{val:1719215150709832, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:56.323944] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:56.324006] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f47366f8510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219533370815002, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:56.324095] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=86] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f4736709790}, min_rec_scn={val:1719215150797158000, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:56.324115] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213342229334001, v:0}) [2024-06-24 16:58:56.324135] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215150797158000, v:0}, checkpoint_scn_in_ls_meta={val:1719215150797158000, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:56.324156] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:201314304}, new_base_lsn={lsn:201314304}, lsn={lsn:201314304}) [2024-06-24 16:58:56.324174] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:201314304}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:56.324187] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [343][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:56.328106] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=1, size_used=112620, mem_used=264127488) [2024-06-24 16:58:56.333862] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219536333572000, start_id=1719219536333572000, end_id=1719219536333572001) [2024-06-24 16:58:56.345001] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=31] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:56.359980] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [1599][T1003_TenantWea][T1003][YB42AC141156-00061B9D93E138C9-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=1.336819486618041992e+02, this=0x7f4703de5208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=668, Throttle Trigger(MB)=401, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.884401192498512501e+01) [2024-06-24 16:58:56.360185] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219536359902000, start_id=1719219536359902000, end_id=1719219536359902001) [2024-06-24 16:58:56.363347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283444342784, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:56.365336] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.372502] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219536371485000, start_id=1719219536371485000, end_id=1719219536371485001) [2024-06-24 16:58:56.373121] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213336545501, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:56.377204] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219536376742000, start_id=1719219536376742000, end_id=1719219536376742001) [2024-06-24 16:58:56.377257] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=35] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:56.377752] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219536377722], gts:1719219536376742000, latest_srr:[mts=1719219536377722]}) [2024-06-24 16:58:56.378071] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:56.378117] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:56.384392] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:56.384437] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:56.384768] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=354, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:56.384796] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1400) [2024-06-24 16:58:56.384820] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:56.384837] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=6, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:56.384860] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=419, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:56.384877] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=23, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:56.389633] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.397801] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219536396752000, start_id=1719219536396752000, end_id=1719219536396752001) [2024-06-24 16:58:56.419816] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219536418892000, start_id=1719219536418892000, end_id=1719219536418892001) [2024-06-24 16:58:56.422798] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=129993, mem_used=326519808) [2024-06-24 16:58:56.425066] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=35] dump dtl interm result cost(us)(dump_cost=1660, ret=0, interm count=0, dump count=628) [2024-06-24 16:58:56.425693] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=11] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:56.425732] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1383][T1004_TabletShe][T1004][Y0-0000000000000000-0-0] [lt=20] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=1237) [2024-06-24 16:58:56.426461] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [162924][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=19] clear dtl interm result cost(us)(clear_cost=1375, ret=0, gc_.expire_keys_.count()=0, dump count=628, interm count=0, clean count=0) [2024-06-24 16:58:56.435269] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA3EF-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.437660] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [383][T1002_ArcSender][T1002][YB42AC141156-00061B9D8D10C0E5-0-0] [lt=30][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:56.438168] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA3F2-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.442125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:56.443747] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F4A-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.446554] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA3FC-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.449680] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0434C9-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.465392] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.471129] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:56.475237] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B8-0-0] [lt=48][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:56.475262] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B8-0-0] [lt=24][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:56.475334] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F6A-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.478291] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA42A-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:56.482976] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F73-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:56.483004] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:56.484472] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:56.484502] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:56.484804] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=350, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:56.484821] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:56.484855] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:56.484877] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=408, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:56.484892] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=21, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:56.485911] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=445, pos=78, bitmap=NULL) [2024-06-24 16:58:56.486024] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:56.486237] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:56.486298] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:56.486463] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:56.486541] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=20][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:56.486651] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077F75-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:56.489691] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.499155] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [743][T1002_L0_G0][T1002][YB42AC141156-00061B9D9AB98A74-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.500051] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [162824][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=39] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:56.533893] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219536533088000, start_id=1719219536533088000, end_id=1719219536533088001) [2024-06-24 16:58:56.534367] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3827) [2024-06-24 16:58:56.534422] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3827) [2024-06-24 16:58:56.534590] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219536333572000, v:0}, new_max_version={val:1719219536333572000, v:0}, last_min_version={val:1719219536133030000, v:0}, last_max_version={val:1719219536133030000, v:0}, total_time_us=2574, delta_us=201016) [2024-06-24 16:58:56.538037] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA47D-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:56.540840] INFO pn_ratelimit (group.c:597) [162516][IngressService][T0][Y0-0000000000000000-0-0] [lt=20] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2024-06-24 16:58:56.541123] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1077FB3-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.559196] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2024-06-24 16:58:56.559231] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=30] start lib cache evict(tenant_id=1002, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:56.559245] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=228589568, mem_limit=375809635, cache_obj_num=753, cache_node_num=750) [2024-06-24 16:58:56.559259] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:56.560254] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219536559519000, start_id=1719219536559519000, end_id=1719219536559519001) [2024-06-24 16:58:56.560839] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219536359902000, v:0}, min_version={val:1719219536359902000, v:0}, max_version={val:1719219536359902000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:56.563875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283442245632, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:56.565452] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.567802] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=753, alloc_obj_list=[{obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:206, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:208, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:213, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:215, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:218, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:219, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:221, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:222, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:223, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:224, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:225, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:226, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:227, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:230, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:258, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:259, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207636}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157087}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:262, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417132}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:293, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:297, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178532}, {obj_id:299, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174372}, {obj_id:311, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:312, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:313, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:314, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:315, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:316, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:317, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:318, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:319, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:320, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:370, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:371, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:372, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:373, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:374, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:375, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:376, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:377, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:378, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:394, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217236}, {obj_id:404, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:405, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:431, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200789}, {obj_id:787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:1554, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174647}, {obj_id:1765, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196131}, {obj_id:1767, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180746}, {obj_id:1768, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180053}, {obj_id:1769, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156392}, {obj_id:1770, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185682}, {obj_id:1771, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178754}, {obj_id:1772, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217927}, {obj_id:1773, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182452}, {obj_id:1774, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157145}, {obj_id:1775, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193250}, {obj_id:1776, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156261}, {obj_id:1777, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202011}, {obj_id:1778, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176126}, {obj_id:1779, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:1780, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179533}, {obj_id:1782, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194286}, {obj_id:1783, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191084}, {obj_id:1784, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185716}, {obj_id:1785, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197901}, {obj_id:1786, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203431}, {obj_id:1787, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177702}, {obj_id:1788, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197376}, {obj_id:1789, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194100}, {obj_id:1790, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229422}, {obj_id:1791, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342799}, {obj_id:1792, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177856}, {obj_id:1793, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:1794, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:1801, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197017}, {obj_id:1802, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197375}, {obj_id:1803, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192944}, {obj_id:1804, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210981}, {obj_id:1807, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1808, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191543}, {obj_id:1809, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190396}, {obj_id:1810, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179961}, {obj_id:1811, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187508}, {obj_id:1812, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190770}, {obj_id:1814, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174667}, {obj_id:1817, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186991}, {obj_id:1820, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181584}, {obj_id:1822, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201206}, {obj_id:1823, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187930}, {obj_id:1824, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182810}, {obj_id:1826, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205149}, {obj_id:1828, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181586}, {obj_id:1830, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184827}, {obj_id:1832, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173928}, {obj_id:1833, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241466}, {obj_id:1834, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173654}, {obj_id:1835, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174122}, {obj_id:1841, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183277}, {obj_id:1842, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202767}, {obj_id:1843, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184717}, {obj_id:1844, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179338}, {obj_id:1845, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192322}, {obj_id:1846, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186117}, {obj_id:1847, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:243066}, {obj_id:1850, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203203}, {obj_id:1851, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206987}, {obj_id:1854, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202239}, {obj_id:1857, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179623}, {obj_id:1858, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199630}, {obj_id:1859, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181089}, {obj_id:1860, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191144}, {obj_id:1861, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208300}, {obj_id:1862, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207006}, {obj_id:1864, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174459}, {obj_id:1865, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197772}, {obj_id:1866, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195985}, {obj_id:1867, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187545}, {obj_id:1868, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200975}, {obj_id:1869, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190129}, {obj_id:1870, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187648}, {obj_id:1871, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180383}, {obj_id:1872, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176694}, {obj_id:1873, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199714}, {obj_id:1874, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197401}, {obj_id:1875, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211269}, {obj_id:1878, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197823}, {obj_id:1879, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180556}, {obj_id:1880, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186838}, {obj_id:1881, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173640}, {obj_id:1882, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189084}, {obj_id:1883, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182778}, {obj_id:1884, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198543}, {obj_id:1885, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184808}, {obj_id:1886, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192715}, {obj_id:1887, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178511}, {obj_id:1889, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:1890, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190883}, {obj_id:1892, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204317}, {obj_id:1895, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200704}, {obj_id:1897, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180059}, {obj_id:1898, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189670}, {obj_id:1899, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297520}, {obj_id:1900, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180210}, {obj_id:1901, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173929}, {obj_id:1902, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207174}, {obj_id:1904, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180315}, {obj_id:1905, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175944}, {obj_id:1906, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191394}, {obj_id:1907, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205016}, {obj_id:1908, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205015}, {obj_id:1909, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205042}, {obj_id:1910, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183144}, {obj_id:1912, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156278}, {obj_id:1914, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201207}, {obj_id:1915, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205705}, {obj_id:1916, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179043}, {obj_id:1918, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210554}, {obj_id:1919, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211414}, {obj_id:1920, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203461}, {obj_id:1922, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179984}, {obj_id:1924, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194777}, {obj_id:1926, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212517}, {obj_id:1927, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185341}, {obj_id:1928, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211233}, {obj_id:1929, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180552}, {obj_id:1930, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199580}, {obj_id:1932, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200277}, {obj_id:1933, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202039}, {obj_id:1935, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202217}, {obj_id:1938, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:1939, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185428}, {obj_id:1940, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:342648}, {obj_id:1941, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184408}, {obj_id:1942, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188029}, {obj_id:1943, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220581}, {obj_id:1944, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186138}, {obj_id:1945, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188109}, {obj_id:1946, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184071}, {obj_id:1947, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:297497}, {obj_id:1948, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259587}, {obj_id:1949, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234741}, {obj_id:1950, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230127}, {obj_id:1951, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:1952, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199425}, {obj_id:1953, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204260}, {obj_id:1955, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186747}, {obj_id:1956, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186410}, {obj_id:1957, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180371}, {obj_id:1959, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186746}, {obj_id:1960, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:314579}, {obj_id:1961, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316276}, {obj_id:1962, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179253}, {obj_id:1963, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198957}, {obj_id:1964, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253315}, {obj_id:1965, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194531}, {obj_id:1966, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181919}, {obj_id:1968, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204268}, {obj_id:1969, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:1970, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156216}, {obj_id:1971, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:1973, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206972}, {obj_id:1974, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372622}, {obj_id:1975, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:1976, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:1977, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255312}, {obj_id:1978, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255070}, {obj_id:1979, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281856}, {obj_id:1980, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312870}, {obj_id:1982, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:1983, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210959}, {obj_id:1984, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:1986, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216413}, {obj_id:1987, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:1988, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207457}, {obj_id:1989, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197063}, {obj_id:1990, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202377}, {obj_id:1991, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319848}, {obj_id:1993, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177048}, {obj_id:1994, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179527}, {obj_id:1996, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:390465}, {obj_id:1997, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181650}, {obj_id:1998, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180128}, {obj_id:1999, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175288}, {obj_id:2000, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179784}, {obj_id:2001, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183026}, {obj_id:2002, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179032}, {obj_id:2003, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186850}, {obj_id:2004, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207791}, {obj_id:2005, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188599}, {obj_id:2006, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241706}, {obj_id:2007, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179781}, {obj_id:2008, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189180}, {obj_id:2010, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175346}, {obj_id:2011, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182950}, {obj_id:2012, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178932}, {obj_id:2013, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184319}, {obj_id:2014, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182003}, {obj_id:2015, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:383980}, {obj_id:2016, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175770}, {obj_id:2017, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180015}, {obj_id:2018, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219419}, {obj_id:2019, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204596}, {obj_id:2020, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181397}, {obj_id:2021, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179054}, {obj_id:2022, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156256}, {obj_id:2023, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237344}, {obj_id:2024, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209999}, {obj_id:2025, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230256}, {obj_id:2026, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188496}, {obj_id:2027, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179278}, {obj_id:2028, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192304}, {obj_id:2029, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195605}, {obj_id:2030, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183563}, {obj_id:2031, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182637}, {obj_id:2033, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:392174}, {obj_id:2035, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:304600}, {obj_id:2037, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184788}, {obj_id:2038, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185565}, {obj_id:2039, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181321}, {obj_id:2040, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204506}, {obj_id:2041, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:348902}, {obj_id:2042, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222494}, {obj_id:2043, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220331}, {obj_id:2044, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181427}, {obj_id:2045, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226680}, {obj_id:2046, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192432}, {obj_id:2047, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225643}, {obj_id:2048, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174740}, {obj_id:2049, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215812}, {obj_id:2050, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196675}, {obj_id:2051, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179861}, {obj_id:2052, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204953}, {obj_id:2053, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196998}, {obj_id:2054, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179552}, {obj_id:2055, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197192}, {obj_id:2056, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187268}, {obj_id:2057, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185914}, {obj_id:2058, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205463}, {obj_id:2059, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:391976}, {obj_id:2060, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202155}, {obj_id:2061, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207183}, {obj_id:2062, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228354}, {obj_id:2063, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240497}, {obj_id:2064, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182911}, {obj_id:2065, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218028}, {obj_id:2066, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210463}, {obj_id:2067, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176755}, {obj_id:2068, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2069, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198027}, {obj_id:2070, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181248}, {obj_id:2071, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179856}, {obj_id:2072, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185425}, {obj_id:2073, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:365208}, {obj_id:2074, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189692}, {obj_id:2075, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183454}, {obj_id:2076, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238844}, {obj_id:2077, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321800}, {obj_id:2078, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186250}, {obj_id:2079, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196079}, {obj_id:2080, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332305}, {obj_id:2081, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320208}, {obj_id:2082, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251367}, {obj_id:2083, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182508}, {obj_id:2084, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:300805}, {obj_id:2085, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178980}, {obj_id:2086, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178916}, {obj_id:2087, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209270}, {obj_id:2088, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184260}, {obj_id:2089, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183375}, {obj_id:2090, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:240830}, {obj_id:2091, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201771}, {obj_id:2092, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192848}, {obj_id:2093, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185409}, {obj_id:2094, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185960}, {obj_id:2095, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178833}, {obj_id:2096, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184221}, {obj_id:2098, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186713}, {obj_id:2099, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215730}, {obj_id:2101, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197347}, {obj_id:2102, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193779}, {obj_id:2103, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234706}, {obj_id:2104, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179916}, {obj_id:2105, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204599}, {obj_id:2106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208576}, {obj_id:2107, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196385}, {obj_id:2108, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2109, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179793}, {obj_id:2110, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180200}, {obj_id:2112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181778}, {obj_id:2114, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210988}, {obj_id:2115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209186}, {obj_id:2116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197363}, {obj_id:2117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223906}, {obj_id:2118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201491}, {obj_id:2119, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292238}, {obj_id:2120, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207205}, {obj_id:2122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226896}, {obj_id:2123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181523}, {obj_id:2124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213117}, {obj_id:2125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:2126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179447}, {obj_id:2127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183182}, {obj_id:2128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184816}, {obj_id:2129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200736}, {obj_id:2130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224430}, {obj_id:2132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207161}, {obj_id:2133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192675}, {obj_id:2135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385804}, {obj_id:2137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175521}, {obj_id:2139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175153}, {obj_id:2143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175169}, {obj_id:2145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175121}, {obj_id:2147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175185}, {obj_id:2149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175553}, {obj_id:2151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230239}, {obj_id:2153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198385}, {obj_id:2155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202184}, {obj_id:2156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205408}, {obj_id:2157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206436}, {obj_id:2158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174583}, {obj_id:2162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213869}, {obj_id:2163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195408}, {obj_id:2164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175356}, {obj_id:2165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203912}, {obj_id:2166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182577}, {obj_id:2167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181498}, {obj_id:2168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199791}, {obj_id:2169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184951}, {obj_id:2170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265434}, {obj_id:2171, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186761}, {obj_id:2172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180107}, {obj_id:2173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205227}, {obj_id:2174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210318}, {obj_id:2175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196533}, {obj_id:2176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180448}, {obj_id:2177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185110}, {obj_id:2178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191697}, {obj_id:2179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217620}, {obj_id:2180, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221861}, {obj_id:2181, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185962}, {obj_id:2182, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:422104}, {obj_id:2183, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190931}, {obj_id:2184, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192945}, {obj_id:2185, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179350}, {obj_id:2186, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200802}, {obj_id:2187, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188846}, {obj_id:2188, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417908}, {obj_id:2189, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180199}, {obj_id:2195, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207911}, {obj_id:2203, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188121}, {obj_id:2204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196915}, {obj_id:2205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:385249}, {obj_id:2209, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2210, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2211, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192183}, {obj_id:2212, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem [2024-06-24 16:58:56.569592] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [163737][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=1787] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:56.569643] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=47] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:56.569688] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:589) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=14] dump dtl interm result cost(us)(dump_cost=1863, ret=0, interm count=0, dump count=621) [2024-06-24 16:58:56.571301] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:604) [163804][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=28] clear dtl interm result cost(us)(clear_cost=1583, ret=0, gc_.expire_keys_.count()=0, dump count=621, interm count=0, clean count=0) [2024-06-24 16:58:56.572551] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219536572160000, start_id=1719219536572160000, end_id=1719219536572160001) [2024-06-24 16:58:56.572633] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:56.572667] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:56.573440] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=395, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:56.573473] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:56.573499] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=8, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:56.573529] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=461, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:56.573548] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=28, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:56.584526] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=30] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:56.586335] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:56.586437] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [910][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219526709080000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:56.589749] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.590755] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA4B9-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4796, pos=2788, bitmap=NULL) [2024-06-24 16:58:56.597895] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219536597533000, start_id=1719219536597533000, end_id=1719219536597533001) [2024-06-24 16:58:56.614877] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] ====== tenant freeze timer task ====== [2024-06-24 16:58:56.619917] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219536619746000, start_id=1719219536619746000, end_id=1719219536619746001) [2024-06-24 16:58:56.622085] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=25] gc stale ls task succ [2024-06-24 16:58:56.622404] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=14] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:56.642218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:56.645835] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=52] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:56.652633] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC43-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103432743997, cache_obj->added_lc()=false, cache_obj->get_object_id()=9382, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:56.665509] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.678567] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=364, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:56.678593] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:56.678613] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:56.678663] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=448, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:56.678686] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=23, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:56.678779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [972][T1001_SSTableGC][T1001][YB42AC141156-00061B9D9650C1B3-0-0] [lt=20] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217726709080000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217726709080000) [2024-06-24 16:58:56.688196] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:124) [972][T1001_SSTableGC][T1001][YB42AC141156-00061B9D9650C1B3-0-0] [lt=43] SSTableGCTask(cost_ts=10285) [2024-06-24 16:58:56.689806] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.701092] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:56.710604] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1719219536710591, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-06-24 16:58:56.713369] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1353][T1004_LockWaitM][T1004][Y0-0000000000000000-0-0] [lt=11] report RowHolderMapper summary info(count=2620, bkt_cnt=7838) [2024-06-24 16:58:56.715988] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=13] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13770, offset=3459124}, end_cursor:ObLogCursor{file_id=1, log_id=13771, offset=3459397}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9d9c050, len:1996, log_data_len:273, seq:13770, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:56.718752] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7462) [2024-06-24 16:58:56.718797] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7462) [2024-06-24 16:58:56.718834] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=423, avg_log_submit_to_slide_time=435) [2024-06-24 16:58:56.719238] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D91F-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219536719003000, start_id=1719219536719003000, end_id=1719219536719003001) [2024-06-24 16:58:56.720256] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13771, offset=3459397}, end_cursor:ObLogCursor{file_id=1, log_id=13772, offset=3459662}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9da0050, len:1723, log_data_len:265, seq:13771, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:56.726456] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10780EF-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.729208] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA562-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.731656] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:56.733443] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078100-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.734135] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1719219536733828000, start_id=1719219536733828000, end_id=1719219536733828001) [2024-06-24 16:58:56.734581] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=361, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:56.734616] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:56.736047] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA569-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.737665] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [967][T1001_ArcSender][T1001][YB42AC141156-00061B9D8DB0C0E5-0-0] [lt=29][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:56.738708] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA56B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.743037] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD5B-0-0] [lt=25] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:56.756631] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107812D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.759352] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA584-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:56.760550] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219536760218000, start_id=1719219536760218000, end_id=1719219536760218001) [2024-06-24 16:58:56.763998] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04357A-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:56.764375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283440148480, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:56.765568] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.766552] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:56.766606] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:56.766694] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:56.766725] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=9][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:56.766790] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:56.766820] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:56.766857] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107813D-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:56.772685] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219536771812000, start_id=1719219536771812000, end_id=1719219536771812001) [2024-06-24 16:58:56.774083] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078146-0-0] [lt=7] get number(ret=0, service_type_=0, range=1, base_id=1719219536773929000, start_id=1719219536773929000, end_id=1719219536773929001) [2024-06-24 16:58:56.779764] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA5B3-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.785041] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1098) [2024-06-24 16:58:56.789865] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.797995] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219536797171000, start_id=1719219536797171000, end_id=1719219536797171001) [2024-06-24 16:58:56.798071] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:56.798106] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:56.798469] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=353, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:56.798506] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:56.798523] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:56.798547] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=419, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:56.798563] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=24, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:56.803069] WDIAG [SQL.ENG] get_next_partition (ob_hp_infras_vec_op.cpp:1443) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD211-0-0] [lt=27][errcode=-4008] failed to get next partition(ret=-4008) [2024-06-24 16:58:56.809722] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA5D6-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:56.811574] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107818E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.812835] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2024-06-24 16:58:56.812879] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=31] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:56.812915] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=19] cannot_recycle_log_size statistics(cannot_recycle_log_size=53536692, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:56.820012] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219536819334000, start_id=1719219536819334000, end_id=1719219536819334001) [2024-06-24 16:58:56.823652] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:56.823703] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [1604][T1003_TabletShe][T1003][Y0-0000000000000000-0-0] [lt=35] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1237) [2024-06-24 16:58:56.826838] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221494488, support_ssl=false) [2024-06-24 16:58:56.826927] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=36] sm conn init succ(conn.sessid_=3221494488, sess.client_addr_="172.20.17.86:49546") [2024-06-24 16:58:56.826955] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f47833c2d70, session_id:3221494488, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:56.827007] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2d70, session_id:3221494488, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:56.827039] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221494488, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:56.827058] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=17] sock ref clean, do destroy(*s={this:0x7f47833c2d70, session_id:3221494488, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:56.827083] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494488) [2024-06-24 16:58:56.827097] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162513][sql_nio23][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494488, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:56.828549] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=17] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=30, mem_used=49913856) [2024-06-24 16:58:56.828591] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=31] release old cannot free more memory [2024-06-24 16:58:56.828612] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=64, size_used=0, mem_used=49913856) [2024-06-24 16:58:56.842308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:56.856019] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA61B-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:56.865632] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.873429] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873670] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=12] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873698] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=19] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873779] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873822] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873817] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.873964] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874124] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874263] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874331] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874329] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874354] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874357] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874361] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874434] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874445] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874714] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874716] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874717] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874724] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874728] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874727] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874726] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874737] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.874741] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:56.878153] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219536877389000, start_id=1719219536877389000, end_id=1719219536877389001) [2024-06-24 16:58:56.878184] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] ts response task statistics(alloc_count=249042, free_count=124520) [2024-06-24 16:58:56.878212] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1719219536878145], gts:1719219536877389000, latest_srr:[mts=1719219536878145]}) [2024-06-24 16:58:56.878254] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1719219536878236], gts:1719219536877389000, latest_srr:[mts=1719219536878236]}) [2024-06-24 16:58:56.878285] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=16] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1719219536878270], gts:1719219536877389000, latest_srr:[mts=1719219536878270]}) [2024-06-24 16:58:56.878315] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1003, need_refresh=false, gts_local_cache={srr:[mts=1719219536878300], gts:1719219536877389000, latest_srr:[mts=1719219536878300]}) [2024-06-24 16:58:56.878737] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:56.881174] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=13265, mem_used=97747968) [2024-06-24 16:58:56.885119] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=390, avg_log_submit_to_slide_time=399) [2024-06-24 16:58:56.889922] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.912641] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=18] gc stale ls task succ [2024-06-24 16:58:56.934347] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219536934276000, start_id=1719219536934276000, end_id=1719219536934276001) [2024-06-24 16:58:56.934430] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=5193, avg_group_log_size=472) [2024-06-24 16:58:56.934458] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4731) [2024-06-24 16:58:56.948182] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] Garbage Collector is running(seq_=622, gc_interval=10000000) [2024-06-24 16:58:56.948264] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=33] self is leader, skip it(ls->get_ls_id()={id:1}) [2024-06-24 16:58:56.948287] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] self is leader, skip it(ls->get_ls_id()={id:1001}) [2024-06-24 16:58:56.948314] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=96) [2024-06-24 16:58:56.948333] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2024-06-24 16:58:56.950291] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=15] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:56.952158] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1754) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=31] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2024-06-24 16:58:56.952193] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=30] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:56.952224] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1776) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=29] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2024-06-24 16:58:56.952239] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1831) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=47) [2024-06-24 16:58:56.952253] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [163824][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2024-06-24 16:58:56.960647] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219536959607000, start_id=1719219536959607000, end_id=1719219536959607001) [2024-06-24 16:58:56.964411] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6AA-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219536963836000, start_id=1719219536963836000, end_id=1719219536963836001) [2024-06-24 16:58:56.964506] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6AA-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=3374, avg_group_log_size=281) [2024-06-24 16:58:56.964533] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6AA-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3374) [2024-06-24 16:58:56.964886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283440148480, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:56.964921] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=6] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3374) [2024-06-24 16:58:56.964968] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=3374) [2024-06-24 16:58:56.965001] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=362, avg_log_submit_to_slide_time=373) [2024-06-24 16:58:56.965688] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.966016] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=27] ====== tenant freeze timer task ====== [2024-06-24 16:58:56.970878] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=38] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:56.972878] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219536972293000, start_id=1719219536972293000, end_id=1719219536972293001) [2024-06-24 16:58:56.986270] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6CA-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.988235] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10782C5-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4812, pos=2770, bitmap=NULL) [2024-06-24 16:58:56.989979] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:56.993564] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0435E7-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:56.995434] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10782D0-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:56.998003] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6DD-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:56.998123] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719219536997631000, start_id=1719219536997631000, end_id=1719219536997631001) [2024-06-24 16:58:57.003969] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=20] gc stale ls task succ [2024-06-24 16:58:57.016993] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6F8-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.019653] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6FA-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.019635] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:787) [163649][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=28] ps cache evict(tenant_id=1, stmt_id_map_.size()=12, stmt_info_map_.size()=12, op.get_used_size()=26439, get_mem_high()=410706180, expired_stmt_ids.count()=0, closed_stmt_ids.count()=12) [2024-06-24 16:58:57.020119] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219537019813000, start_id=1719219537019813000, end_id=1719219537019813001) [2024-06-24 16:58:57.023923] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA6FE-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.026518] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:57.026610] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:57.026791] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:57.026847] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:57.026978] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:57.027042] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:57.027123] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA703-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:57.037092] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:57.037124] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:57.037157] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348926389, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:57.038732] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA718-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.039077] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [1453][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=38] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2024-06-24 16:58:57.042396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:57.054818] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=10] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1004) [2024-06-24 16:58:57.054847] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=25] start lib cache evict(tenant_id=1004, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:57.054864] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=15] end lib cache evict(tenant_id=1004, cache_evict_num=0, mem_hold=148897792, mem_limit=773094110, cache_obj_num=497, cache_node_num=493) [2024-06-24 16:58:57.054876] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=10] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:57.057002] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:57.061770] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=33] Dumping All Cache Objs(alloc_obj_list.count()=497, alloc_obj_list=[{obj_id:35, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:39, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:40, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184250}, {obj_id:41, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:43, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:45, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:53, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175298}, {obj_id:84, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174332}, {obj_id:145, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:146, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:147, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:148, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:151, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:152, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:153, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:154, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:155, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:156, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:157, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:158, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:159, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:160, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198897}, {obj_id:161, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:162, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:163, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:164, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:165, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:166, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:167, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:168, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:169, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:170, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:171, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:172, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:173, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:174, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:175, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:176, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:177, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175451}, {obj_id:178, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181217}, {obj_id:179, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:180, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:181, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:182, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235894}, {obj_id:183, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209782}, {obj_id:184, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230576}, {obj_id:185, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:186, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:187, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:188, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:189, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:190, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:191, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:192, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:193, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:195, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:196, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:197, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:198, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:199, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:200, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:201, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:202, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:203, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:204, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:205, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:206, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:207, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:208, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:209, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:210, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:211, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:212, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:213, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:214, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:215, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:216, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299219}, {obj_id:217, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236649}, {obj_id:218, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:219, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184514}, {obj_id:220, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180217}, {obj_id:221, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181306}, {obj_id:222, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191369}, {obj_id:223, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180301}, {obj_id:224, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:225, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:226, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:227, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:228, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183169}, {obj_id:229, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:230, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:232, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193139}, {obj_id:235, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172575}, {obj_id:236, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183655}, {obj_id:237, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185248}, {obj_id:238, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:239, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:240, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:241, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179186}, {obj_id:242, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188148}, {obj_id:243, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:244, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:245, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:246, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:247, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:248, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:249, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:250, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:251, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:252, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200937}, {obj_id:253, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:254, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:255, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206580}, {obj_id:256, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208496}, {obj_id:257, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:258, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308540}, {obj_id:260, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207652}, {obj_id:261, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:262, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172752}, {obj_id:263, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174272}, {obj_id:264, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178940}, {obj_id:265, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:266, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:267, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:268, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:269, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:270, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161399}, {obj_id:271, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156376}, {obj_id:272, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157105}, {obj_id:273, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175095}, {obj_id:274, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176760}, {obj_id:275, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185989}, {obj_id:276, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:277, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:278, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:279, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419083}, {obj_id:280, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417152}, {obj_id:283, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239831}, {obj_id:284, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242976}, {obj_id:285, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256105}, {obj_id:286, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:256298}, {obj_id:287, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:288, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:289, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:290, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:291, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:292, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:293, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:294, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231047}, {obj_id:295, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281088}, {obj_id:296, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219046}, {obj_id:297, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189001}, {obj_id:298, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186674}, {obj_id:299, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215340}, {obj_id:300, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:301, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:302, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:303, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:304, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:307, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:308, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:311, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:375291}, {obj_id:312, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:384468}, {obj_id:313, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325700}, {obj_id:314, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:334948}, {obj_id:315, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227240}, {obj_id:316, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268192}, {obj_id:317, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200156}, {obj_id:318, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206516}, {obj_id:335, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350060}, {obj_id:337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182212}, {obj_id:338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232348}, {obj_id:339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290625}, {obj_id:340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228030}, {obj_id:341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199088}, {obj_id:342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200335}, {obj_id:343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290589}, {obj_id:344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180926}, {obj_id:345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200383}, {obj_id:348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182820}, {obj_id:349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191406}, {obj_id:352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:362, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204485}, {obj_id:363, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224055}, {obj_id:366, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185366}, {obj_id:367, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195268}, {obj_id:368, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215882}, {obj_id:375, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:376, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:379, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:380, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234934}, {obj_id:381, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:382, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:383, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:384, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218544}, {obj_id:385, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:386, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:387, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:388, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:391, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189184}, {obj_id:392, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201018}, {obj_id:395, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191754}, {obj_id:396, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204870}, {obj_id:399, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:400, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:403, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:404, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:407, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:408, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199110}, {obj_id:411, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:412, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:425, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:426, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233649}, {obj_id:427, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:428, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:429, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199416}, {obj_id:430, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217209}, {obj_id:431, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:432, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:433, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:434, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:437, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201929}, {obj_id:438, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220211}, {obj_id:441, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186646}, {obj_id:442, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197186}, {obj_id:449, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187051}, {obj_id:450, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236235}, {obj_id:451, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291681}, {obj_id:452, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229118}, {obj_id:453, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200168}, {obj_id:454, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219871}, {obj_id:455, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201375}, {obj_id:456, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291677}, {obj_id:457, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181926}, {obj_id:458, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201455}, {obj_id:461, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198111}, {obj_id:462, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214476}, {obj_id:473, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212131}, {obj_id:474, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235568}, {obj_id:489, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203200}, {obj_id:490, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222135}, {obj_id:493, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:494, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:497, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252923}, {obj_id:498, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296972}, {obj_id:509, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:510, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237536}, {obj_id:511, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292049}, {obj_id:512, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229486}, {obj_id:513, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200544}, {obj_id:514, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221206}, {obj_id:515, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201791}, {obj_id:516, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292045}, {obj_id:517, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182278}, {obj_id:518, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201839}, {obj_id:521, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263105}, {obj_id:522, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312324}, {obj_id:527, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269484}, {obj_id:528, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321943}, {obj_id:537, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254176}, {obj_id:538, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:298902}, {obj_id:551, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251638}, {obj_id:552, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295058}, {obj_id:555, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223603}, {obj_id:556, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252824}, {obj_id:573, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190308}, {obj_id:574, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238837}, {obj_id:575, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292385}, {obj_id:576, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229822}, {obj_id:577, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200872}, {obj_id:578, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222549}, {obj_id:579, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202111}, {obj_id:580, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:292381}, {obj_id:581, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182630}, {obj_id:582, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202159}, {obj_id:587, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:588, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:611, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205738}, {obj_id:612, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225979}, {obj_id:625, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274568}, {obj_id:626, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329621}, {obj_id:643, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:644, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:645, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206454}, {obj_id:646, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:647, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:648, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:649, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197356}, {obj_id:650, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178512}, {obj_id:651, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198928}, {obj_id:652, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199105}, {obj_id:653, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156378}, {obj_id:654, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157162}, {obj_id:655, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176121}, {obj_id:656, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176125}, {obj_id:657, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:307685}, {obj_id:658, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419883}, {obj_id:660, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312830}, {obj_id:661, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:662, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:663, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:664, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202402}, {obj_id:665, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:666, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216429}, {obj_id:667, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:668, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157107}, {obj_id:669, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176570}, {obj_id:670, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176412}, {obj_id:672, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176080}, {obj_id:673, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156195}, {obj_id:674, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215308}, {obj_id:676, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177573}, {obj_id:677, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:372653}, {obj_id:678, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176992}, {obj_id:679, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179733}, {obj_id:680, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255326}, {obj_id:681, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:255084}, {obj_id:682, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281876}, {obj_id:683, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:319873}, {obj_id:684, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209231}, {obj_id:700, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192790}, {obj_id:701, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257630}, {obj_id:702, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234000}, {obj_id:731, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200128}, {obj_id:733, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:409897}, {obj_id:734, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:400862}, {obj_id:736, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175113}, {obj_id:737, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184566}, {obj_id:742, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175296}, {obj_id:743, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181792}, {obj_id:746, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185582}, {obj_id:747, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:797, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200312}, {obj_id:798, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198098}, {obj_id:799, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:288253}, {obj_id:800, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188621}, {obj_id:801, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200393}, {obj_id:802, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213250}, {obj_id:803, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328028}, {obj_id:804, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198852}, {obj_id:805, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:806, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:807, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:808, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:809, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174410}, {obj_id:815, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173948}, {obj_id:825, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185181}, {obj_id:828, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238944}, {obj_id:832, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:833, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:834, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:835, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188030}, {obj_id:836, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188748}, {obj_id:837, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207583}, {obj_id:838, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220441}, {obj_id:839, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189684}, {obj_id:840, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183154}, {obj_id:841, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246969}, {obj_id:842, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249608}, {obj_id:843, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231450}, {obj_id:844, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180118}, {obj_id:845, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268752}, {obj_id:846, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270542}, {obj_id:847, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270227}, {obj_id:848, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273208}, {obj_id:849, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257627}, {obj_id:850, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273232}, {obj_id:851, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254489}, {obj_id:852, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269717}, {obj_id:853, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175231}, {obj_id:854, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181662}, {obj_id:855, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177134}, {obj_id:861, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177715}, {obj_id:869, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187847}, {obj_id:879, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200764}, {obj_id:880, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200755}, {obj_id:930, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:466821}, {obj_id:931, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:932, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296709}, {obj_id:933, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318958}, {obj_id:934, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312747}, {obj_id:935, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325200}, {obj_id:936, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217553}, {obj_id:937, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281577}, {obj_id:938, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189394}, {obj_id:939, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:641561}, {obj_id:940, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:244732}, {obj_id:941, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232660}, {obj_id:942, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:943, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192070}, {obj_id:944, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217413}, {obj_id:945, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189522}, {obj_id:946, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232546}, {obj_id:1073, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246494}, {obj_id:1140, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:378647}, {obj_id:1141, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306509}, {obj_id:1142, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1143, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:1144, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198777}, {obj_id:1194, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247404}, {obj_id:1320, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:438066}, {obj_id:1321, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260903}, {obj_id:1322, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206816}, {obj_id:1323, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193061}, {obj_id:1324, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178317}, {obj_id:1325, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182140}, {obj_id:1326, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174724}, {obj_id:1327, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195853}, {obj_id:1328, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184944}, {obj_id:1329, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201089}, {obj_id:1330, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209476}, {obj_id:1331, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:170609}, {obj_id:1332, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171169}, {obj_id:1333, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203806}, {obj_id:1334, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200651}, {obj_id:1336, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195256}, {obj_id:1337, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203334}, {obj_id:1338, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198057}, {obj_id:1339, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192160}, {obj_id:1340, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194971}, {obj_id:1341, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196164}, {obj_id:1342, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198958}, {obj_id:1343, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197940}, {obj_id:1344, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200683}, {obj_id:1345, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197036}, {obj_id:1346, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199801}, {obj_id:1347, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204590}, {obj_id:1348, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197459}, {obj_id:1349, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207323}, {obj_id:1350, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200262}, {obj_id:1351, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194377}, {obj_id:1352, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197164}, {obj_id:1353, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199224}, {obj_id:1354, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201933}, {obj_id:1355, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202018}, {obj_id:1356, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206006}, {obj_id:1357, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204664}, {obj_id:1358, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205068}, {obj_id:1359, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208689}, {obj_id:1360, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207750}, {obj_id:1361, tenant_id:1004, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209040}, {obj_id:13 [2024-06-24 16:58:57.063244] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [1227][T1004_PlanCache][T1004][Y0-0000000000000000-0-0] [lt=1470] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:57.065746] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.068333] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078339-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.069887] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107833A-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:57.076537] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 357.50) [2024-06-24 16:58:57.076561] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:57.076665] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 1.00, rt: 354.00) [2024-06-24 16:58:57.076682] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:57.076710] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076727] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076744] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076755] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076767] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076778] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076789] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076800] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076813] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076825] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076836] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076848] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076859] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076870] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076882] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.076894] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:57.077708] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [162957][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=23] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f4841ffc2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:57.078482] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:57.078525] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:57.078559] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:57.078900] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=354, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:57.078902] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1913) [2024-06-24 16:58:57.078936] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:57.078963] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=388, avg_log_submit_to_slide_time=398) [2024-06-24 16:58:57.079948] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=15] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:57.079993] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=32] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:57.080015] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [1603][T1003_ObTimer][T1003][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1236) [2024-06-24 16:58:57.080939] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1719219537080934, bytes: 171145542, bw: 0.019928 MB/s, add_ts: 1007615, add_bytes: 21055 [2024-06-24 16:58:57.082907] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=30] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16523, offset=3765869}, end_cursor:ObLogCursor{file_id=1, log_id=16524, offset=3766142}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9da4050, len:2451, log_data_len:273, seq:16523, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:57.084828] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:57.084864] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:57.086343] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D910-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219537085326000, start_id=1719219537085326000, end_id=1719219537085326001) [2024-06-24 16:58:57.086426] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D910-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9611, avg_group_log_size=640) [2024-06-24 16:58:57.086450] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D910-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9611) [2024-06-24 16:58:57.086829] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9611) [2024-06-24 16:58:57.086882] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9611) [2024-06-24 16:58:57.086905] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=396, avg_log_submit_to_slide_time=405) [2024-06-24 16:58:57.087507] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=36] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16524, offset=3766142}, end_cursor:ObLogCursor{file_id=1, log_id=16525, offset=3766407}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9da8050, len:2178, log_data_len:265, seq:16524, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:57.090041] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.096641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096654] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096666] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096713] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096747] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096791] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096816] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.096876] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097001] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097035] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097245] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097329] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097339] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097344] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097392] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097413] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097413] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097417] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097615] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097655] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097650] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097656] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097711] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097727] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097776] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=74] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.097832] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098004] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098074] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098135] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098142] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098255] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098330] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098337] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098340] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098510] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098580] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098642] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098646] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098654] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098689] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=52] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098739] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.098808] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1418, mem_used=4159488) [2024-06-24 16:58:57.099080] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.119833] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA789-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.134319] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219537133948000, start_id=1719219537133948000, end_id=1719219537133948001) [2024-06-24 16:58:57.134391] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [1579][T1003_LockWaitM][T1003][Y0-0000000000000000-0-0] [lt=20] report RowHolderMapper summary info(count=2620, bkt_cnt=7830) [2024-06-24 16:58:57.135775] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=13] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:57.147711] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:66) [162946][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=2226, bkt_cnt=7419) [2024-06-24 16:58:57.154619] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1601][T1003_Flush][T1003][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2024-06-24 16:58:57.154823] INFO [MDS] flush (mds_table_mgr.cpp:172) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B9-0-0] [lt=42] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46f1d7c510, is_inited:true, freezing_scn:{val:1719215121039641000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219544521932000, latest_log_ts:{val:1719219527861214001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4700bf8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:57.154963] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1601][T1003_Flush][T1003][YB42AC141156-00061B9D9700C5B9-0-0] [lt=133] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:57.160776] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219537160333000, start_id=1719219537160333000, end_id=1719219537160333001) [2024-06-24 16:58:57.165367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283435954176, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:57.165805] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.172983] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219537172979000, start_id=1719219537172979000, end_id=1719219537172979001) [2024-06-24 16:58:57.176942] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=36] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:57.178557] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1791, avg_group_log_size=199) [2024-06-24 16:58:57.178587] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1791) [2024-06-24 16:58:57.178649] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1098) [2024-06-24 16:58:57.178942] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:57.178965] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:57.178989] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=405, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:57.179004] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=24, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:57.182661] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8ED-0-0] [lt=10] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:57.182680] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8ED-0-0] [lt=18] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:57.185051] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D908-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:57.185079] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D908-0-0] [lt=25] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:57.187406] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=19125970, clean_num=201326) [2024-06-24 16:58:57.190098] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.192015] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1188][T1004_Occam][T1004][YB42AC141156-00061B9D94D0D438-0-0] [lt=22] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:57.198243] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219537197268000, start_id=1719219537197268000, end_id=1719219537197268001) [2024-06-24 16:58:57.200251] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [1380][T1004_Flush][T1004][Y0-0000000000000000-0-0] [lt=14] ====== traversal_flush timer task ====== [2024-06-24 16:58:57.200445] INFO [MDS] flush (mds_table_mgr.cpp:172) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B9-0-0] [lt=29] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219534874606001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219543569925000, latest_log_ts:{val:1719219527359914001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:57.200834] INFO [MDS] flush (mds_table_mgr.cpp:195) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B9-0-0] [lt=128] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, max_consequent_callbacked_scn={val:1719219536878445001, v:0}, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219534874606001, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:57.200940] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [1380][T1004_Flush][T1004][YB42AC141156-00061B9D96D0C5B9-0-0] [lt=103] succeed to traversal_flush(ret=0, ls_cnt=2) [2024-06-24 16:58:57.202650] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:57.220250] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219537219434000, start_id=1719219537219434000, end_id=1719219537219434001) [2024-06-24 16:58:57.226727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [408][T1002_SSTableGC][T1002][YB42AC141156-00061B9D9610C1B3-0-0] [lt=22] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217727132319000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217727132319000) [2024-06-24 16:58:57.235900] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D486-0-0] [lt=24] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:57.236097] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [162820][T1_Occam][T1][YB42AC141156-00061B9D87F0D488-0-0] [lt=27] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:57.241275] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:124) [408][T1002_SSTableGC][T1002][YB42AC141156-00061B9D9610C1B3-0-0] [lt=43] SSTableGCTask(cost_ts=15150) [2024-06-24 16:58:57.250171] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:57.250205] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:57.250609] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:57.250644] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=442, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:57.250658] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=17, avg_log_submit_to_flush_time=413, avg_log_submit_to_slide_time=425) [2024-06-24 16:58:57.250680] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:57.253756] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078480-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4803, pos=2781, bitmap=NULL) [2024-06-24 16:58:57.254616] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=83000000, replace_num=100000) [2024-06-24 16:58:57.254657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:57.256799] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA82B-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.262675] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04365C-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.265800] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA834-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:57.265863] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.268870] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA835-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:57.275026] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1004, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:57.276619] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:57.276726] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1292][T1004_FreInfoRe][T1004][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219536809822000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:57.279030] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1791) [2024-06-24 16:58:57.279060] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=414, avg_log_submit_to_slide_time=422) [2024-06-24 16:58:57.290154] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.290590] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA84E-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.293835] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA850-0-0] [lt=46][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.297169] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784D7-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.299529] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:57.299578] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=12][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:57.299662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=8][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:57.299690] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:57.299754] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:57.299787] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=11][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:57.299827] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10784DA-0-0] [lt=7][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:57.302254] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:57.302282] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:57.302312] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] cannot_recycle_log_size statistics(cannot_recycle_log_size=70457686, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:57.314979] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA86F-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.328240] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112665, mem_used=264127488) [2024-06-24 16:58:57.334094] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA88B-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1719219537333445000, start_id=1719219537333445000, end_id=1719219537333445001) [2024-06-24 16:58:57.334480] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219537333445000, start_id=1719219537333445000, end_id=1719219537333445001) [2024-06-24 16:58:57.334762] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13AA88B-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=36, this=0x7f473495c280, extra_info="") [2024-06-24 16:58:57.334792] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13AA88B-0-0] [lt=28] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=444, this=0x7f473495c4b0, extra_info="") [2024-06-24 16:58:57.334809] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13AA88B-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=0, this=0x7f473495c6e0, extra_info="") [2024-06-24 16:58:57.334824] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13AA88B-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=-512, this=0x7f473495c910, extra_info="") [2024-06-24 16:58:57.334838] INFO [LIB] stat (utility.h:1165) [473][T1002_ApplySrv1][T1002][YB42AC141156-00061B9DA13AA88B-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=-31, this=0x7f473495cb40, extra_info="") [2024-06-24 16:58:57.335654] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=51] ====== tenant freeze timer task ====== [2024-06-24 16:58:57.341611] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078524-0-0] [lt=6] get number(ret=0, service_type_=0, range=1, base_id=1719219537340826000, start_id=1719219537340826000, end_id=1719219537340826001) [2024-06-24 16:58:57.343739] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043683-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.345121] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=21] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:57.346748] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA8A3-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:57.358910] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1003, min_version={val:1719219537160333000, v:0}, base_version={val:1719219536959607000, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219537160333000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1719219537358893, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:57.360922] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1719219537360844000, start_id=1719219537360844000, end_id=1719219537360844001) [2024-06-24 16:58:57.365921] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.372104] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=40] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:57.372959] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [338][T1002_TenantWea][T1001][YB42AC141156-00061B9D903138A1-0-0] [lt=32] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.582890605926513672e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=379, Throttle Trigger(MB)=227, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.485425070768866362e+02) [2024-06-24 16:58:57.373188] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1719219537372424000, start_id=1719219537372424000, end_id=1719219537372424001) [2024-06-24 16:58:57.378707] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:57.378741] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:57.379104] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1719219537378744000, start_id=1719219537378744000, end_id=1719219537378744001) [2024-06-24 16:58:57.379154] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:57.379606] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=19] submit log success(service_type_=0, last_id=1719219553569925000, limited_id=1719219553569925000) [2024-06-24 16:58:57.379645] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1004][Y0-0000000000000000-0-0] [lt=38] submit log with lock success(service_type_=0, last_id=1719219553569925000, limited_id=1719219553569925000) [2024-06-24 16:58:57.379675] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] gts statistics(tenant_id=1004, gts_rpc_cnt=10, get_gts_cache_cnt=363, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:57.382445] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1719219553569925000, latest_scn={val:1719219537378744001, v:0}, *this={tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219534874606001, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219553569925000, latest_log_ts:{val:1719219537378744001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:57.382525] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=78] handle submit callback(service_type_=0, success=true, used_ts=2919, log_ts={val:1719219537378744001, v:0}, limited_id=1719219553569925000) [2024-06-24 16:58:57.382547] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=20] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:57.382564] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:57.384995] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:57.385041] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:57.385406] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=366, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:57.385433] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1791) [2024-06-24 16:58:57.385460] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:57.385481] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:57.385509] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=446, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:57.385528] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=26, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:57.388510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283433857024, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:57.390210] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.392753] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA8D4-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.398384] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219537397725000, start_id=1719219537397725000, end_id=1719219537397725001) [2024-06-24 16:58:57.398995] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213364149839, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:57.400053] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [162964][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=25] XA scheduler heartbeat task statistics(avg_time=3) [2024-06-24 16:58:57.413145] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [163698][T1002_Occam][T1002][YB42AC141156-00061B9D8ED0D44E-0-0] [lt=74] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:57.420380] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1719219537419922000, start_id=1719219537419922000, end_id=1719219537419922001) [2024-06-24 16:58:57.422927] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=130008, mem_used=326519808) [2024-06-24 16:58:57.454748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-06-24 16:58:57.464481] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163799][T1002_TntTransf][T1002][YB42AC141156-00061B9D9190C351-0-0] [lt=33] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=3) [2024-06-24 16:58:57.465980] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.475005] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163796][T1002_TntTransf][T1002][YB42AC141156-00061B9D9160C351-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2024-06-24 16:58:57.483125] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=26] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:57.484755] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B9-0-0] [lt=51][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:57.484780] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8B9-0-0] [lt=23][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:57.485038] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:38) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=18] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2024-06-24 16:58:57.485083] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:99) [162973][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=30] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1257) [2024-06-24 16:58:57.485077] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:57.485110] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:57.485434] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=363, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:57.485464] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=15, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:57.485482] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:57.485504] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=436, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:57.485521] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=24, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:57.490343] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.517882] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1003, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:57.517925] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163798][T1002_TntTransf][T1002][YB42AC141156-00061B9D9180C351-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=2) [2024-06-24 16:58:57.518180] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E94F-0-0] [lt=29] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1719219537518158}) [2024-06-24 16:58:57.518266] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D071-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219537518214, sql_renew_time:1719219537518214, is_mark_fail:false}]) [2024-06-24 16:58:57.518331] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [162306][VTblLocAsyncUp0][T0][YB42AC141156-00061B9D8AF0D071-0-0] [lt=62] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1719219537518158}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"172.20.17.86:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1719219537518214, sql_renew_time:1719219537518214, is_mark_fail:false}]) [2024-06-24 16:58:57.518338] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:141) [163797][T1002_TntTransf][T1002][YB42AC141156-00061B9D9170C351-0-0] [lt=32] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=1) [2024-06-24 16:58:57.519671] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=39] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:57.519784] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [1549][T1003_FreInfoRe][T1003][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219536757048000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:57.520567] INFO [CLOG] is_in_sync (ob_log_handler.cpp:563) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E94F-0-0] [lt=39] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2024-06-24 16:58:57.520753] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [163036][BlackListServic][T1][YB42AC141156-00061B9D87A0E94F-0-0] [lt=35][errcode=-4008] execute fail(ret=-4008) [2024-06-24 16:58:57.528447] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=25] start to print blacklist info [2024-06-24 16:58:57.528652] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [163036][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=30] ls blacklist refresh finish(cost_time=12248) [2024-06-24 16:58:57.534598] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219537533972000, start_id=1719219537533972000, end_id=1719219537533972001) [2024-06-24 16:58:57.535050] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=4617) [2024-06-24 16:58:57.535188] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219537333445000, v:0}, new_max_version={val:1719219537333445000, v:0}, last_min_version={val:1719219537133948000, v:0}, last_max_version={val:1719219537133948000, v:0}, total_time_us=2583, delta_us=201742) [2024-06-24 16:58:57.554068] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA996-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:57.557635] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107866A-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.560981] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219537560399000, start_id=1719219537560399000, end_id=1719219537560399001) [2024-06-24 16:58:57.561612] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219537360844000, v:0}, min_version={val:1719219537360844000, v:0}, max_version={val:1719219537360844000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:57.563701] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9A4-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.566038] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.566793] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043708-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:57.569881] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9AC-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:57.571267] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [338][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=25] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1719219537142392001, v:0}, base_version={val:1719219536976525001, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219537142392001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219537571245, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:57.573261] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219537573086000, start_id=1719219537573086000, end_id=1719219537573086001) [2024-06-24 16:58:57.573347] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:57.573389] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:57.573799] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=353, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:57.573834] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:57.573859] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=6, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:57.573882] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=414, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:57.573895] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=23, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:57.589013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283433857024, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:57.590314] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.595422] WDIAG [OCCAM] dump_statistics (ob_vtable_event_recycle_buffer.h:144) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D437-0-0] [lt=33][errcode=-4006] not init(ret=-4006) [2024-06-24 16:58:57.595477] INFO [MDS] dump_map_holding_item (mds_tenant_service.cpp:466) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D437-0-0] [lt=28] finish scan map holding items(scan_cnt=0) [2024-06-24 16:58:57.595683] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [1449][T1003_Occam][T1003][YB42AC141156-00061B9D9630D438-0-0] [lt=20] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:57.596783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9CB-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.598490] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219537598405000, start_id=1719219537598405000, end_id=1719219537598405001) [2024-06-24 16:58:57.600029] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9CE-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.604892] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D3-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4795, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.607676] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:57.607790] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:57.608002] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:57.608070] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:57.608241] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:57.608320] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:57.608429] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9D7-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:57.620449] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AA9E9-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.620479] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219537619484000, start_id=1719219537619484000, end_id=1719219537619484001) [2024-06-24 16:58:57.622150] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=19] gc stale ls task succ [2024-06-24 16:58:57.622503] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=15] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:57.630334] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1387][T1004_ArcSender][T1004][YB42AC141156-00061B9D9370C0E5-0-0] [lt=14][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:57.650718] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=4739) [2024-06-24 16:58:57.654842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-06-24 16:58:57.658538] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC44-0-0] [lt=17][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103433749908, cache_obj->added_lc()=false, cache_obj->get_object_id()=9383, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:57.662316] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04374B-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.665593] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10786EA-0-0] [lt=40][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:57.666099] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.679318] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=696, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:57.679346] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=14, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:57.679358] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=4, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:57.679382] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=772, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:57.679405] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=20, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:57.690375] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.700775] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:60241, max_lsn:32457313, max_scn:{val:1719219537378744003, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:32457313}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:0}}, last_submit_lsn:{lsn:32457191}, last_submit_end_lsn:{lsn:32457313}, last_submit_log_id:60241, last_submit_log_pid:1, max_flushed_lsn:{lsn:32457191}, max_flushed_end_lsn:{lsn:32457313}, max_flushed_log_pid:1, committed_end_lsn:{lsn:32457313}, last_slide_log_id:60241, last_slide_scn:{val:1719219537378744003, v:0}, last_slide_lsn:{lsn:32457191}, last_slide_end_lsn:{lsn:32457313}, last_slide_log_pid:1, last_slide_log_accum_checksum:613630746, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4753cb2530}, [StateMgr]={this:0x7f4753cb62b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:60242, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213336021808, palf_role_change_cb:0x7f4753cbccb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4753cb3c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/meta", dir_fd:670, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f4753cb8478, flashback_version:0}, log_storage:{log_tail:{lsn:32457313}, readable_log_tail:{lsn:32457313}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:2, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1002/1/log", dir_fd:671, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:34647455, block_header_serialize_buf_:0x7f4753cba138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213336021452, this:0x7f4753cb69f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213336022204, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f4753cb6430}) [2024-06-24 16:58:57.701139] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=358] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219537685556, last_flushed_end_lsn:{lsn:32457313}}]) [2024-06-24 16:58:57.701151] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:57.701171] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=28] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=60242, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219537685556, last_flushed_end_lsn:{lsn:32457313}}]) [2024-06-24 16:58:57.718213] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1719219537718209, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-06-24 16:58:57.721544] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAA7A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.723898] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=15] ====== check clog disk timer task ====== [2024-06-24 16:58:57.723925] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=20] get_disk_usage(ret=0, capacity(MB):=44236, used(MB):=226) [2024-06-24 16:58:57.723975] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13772, offset=3459662}, end_cursor:ObLogCursor{file_id=1, log_id=13773, offset=3459935}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9dac050, len:1458, log_data_len:273, seq:13772, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:57.724000] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1381][T1004_CKClogDis][T1004][Y0-0000000000000000-0-0] [lt=59] cannot_recycle_log_size statistics(cannot_recycle_log_size=103101001, threshold=13915694039, need_update_checkpoint_scn=false) [2024-06-24 16:58:57.727106] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D920-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219537727060000, start_id=1719219537727060000, end_id=1719219537727060001) [2024-06-24 16:58:57.727188] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D920-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9930, avg_group_log_size=662) [2024-06-24 16:58:57.727212] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D920-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=9620) [2024-06-24 16:58:57.727561] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=9930) [2024-06-24 16:58:57.727604] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=9930) [2024-06-24 16:58:57.727663] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=393, avg_log_submit_to_slide_time=405) [2024-06-24 16:58:57.728206] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13773, offset=3459935}, end_cursor:ObLogCursor{file_id=1, log_id=13774, offset=3460200}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9db0050, len:1185, log_data_len:265, seq:13773, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:57.731748] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:57.733969] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1491][T1003_Occam][T1003][Y0-0000000000000000-0-0] [lt=10] ====== tenant freeze timer task ====== [2024-06-24 16:58:57.734684] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219537734462000, start_id=1719219537734462000, end_id=1719219537734462001) [2024-06-24 16:58:57.735077] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=359, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:57.735095] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:57.735968] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:237) [763][T1001_Occam][T1001][YB42AC141156-00061B9D9010D44E-0-0] [lt=16] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2024-06-24 16:58:57.754288] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [163702][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=52] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2024-06-24 16:58:57.761103] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1719219537760884000, start_id=1719219537760884000, end_id=1719219537760884001) [2024-06-24 16:58:57.766158] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.773216] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=44] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:57.773402] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:57.773479] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219537772513000, start_id=1719219537772513000, end_id=1719219537772513001) [2024-06-24 16:58:57.775040] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:57.775149] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [162913][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=28] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219536819334000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:57.779865] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAABB-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219537778834000, start_id=1719219537778834000, end_id=1719219537778834001) [2024-06-24 16:58:57.780000] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04379E-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219537779891000, start_id=1719219537779891000, end_id=1719219537779891001) [2024-06-24 16:58:57.780575] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [683][T1002_L0_G0][T1002][YB42AC141156-00061B9D9B1A0167-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219537779891000, start_id=1719219537779891001, end_id=1719219537779891002) [2024-06-24 16:58:57.785606] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1791) [2024-06-24 16:58:57.789482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283431759872, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:57.790436] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.796646] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=30] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1004, min_version={val:1719219537378744001, v:0}, base_version={val:1719219536878445003, v:0}, server_count=1, svr_array=[{addr:"172.20.17.86:2882", version:{val:1719219537378744001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1719219537796615, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2024-06-24 16:58:57.798414] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219537797828000, start_id=1719219537797828000, end_id=1719219537797828001) [2024-06-24 16:58:57.798478] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:57.798508] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:57.798822] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=36] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=363, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:57.798842] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=16, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:57.798860] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:57.798882] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=422, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:57.798896] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=19, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:57.802279] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=30] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2024-06-24 16:58:57.804079] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:426) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=35] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2024-06-24 16:58:57.804180] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [163795][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=29] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}, freeze_info_={latest_snapshot_gc_scn:{val:1719219537141335000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066048}]}) [2024-06-24 16:58:57.820595] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219537819987000, start_id=1719219537819987000, end_id=1719219537819987001) [2024-06-24 16:58:57.827353] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221494489, support_ssl=false) [2024-06-24 16:58:57.827438] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=31] sm conn init succ(conn.sessid_=3221494489, sess.client_addr_="172.20.17.86:49548") [2024-06-24 16:58:57.827460] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f47833c2030, session_id:3221494489, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:57.827534] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=29][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f47833c2030, session_id:3221494489, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:57.827564] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=26] kill and revert session(conn.sessid_=3221494489, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:57.827582] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=17] sock ref clean, do destroy(*s={this:0x7f47833c2030, session_id:3221494489, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:806}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:57.827605] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494489) [2024-06-24 16:58:57.827619] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162515][sql_nio25][T0][Y0-0000000000000000-0-0] [lt=12] connection close(sessid=3221494489, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:57.828744] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=36] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=39, mem_used=49913856) [2024-06-24 16:58:57.828810] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=30] release old cannot free more memory [2024-06-24 16:58:57.828827] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=15] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=85, size_used=0, mem_used=49913856) [2024-06-24 16:58:57.838914] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:116) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=16] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2024-06-24 16:58:57.838963] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:150) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=33] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2024-06-24 16:58:57.838984] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:240) [162972][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=1254) [2024-06-24 16:58:57.854932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-06-24 16:58:57.858066] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [163191][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=27] current monitor number(seq_=-1) [2024-06-24 16:58:57.866218] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:57.866253] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=33] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1004, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:57.866276] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.873616] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.873649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.873649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.873650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.873756] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.873778] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.873784] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874081] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874097] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874386] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874386] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874441] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874483] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874488] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874489] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874494] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874506] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874650] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874648] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874769] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874771] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874790] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.874882] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:57.879437] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1098) [2024-06-24 16:58:57.880053] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219537880028000, start_id=1719219537880028000, end_id=1719219537880028001) [2024-06-24 16:58:57.880165] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:157) [162401][TsMgr][T1003][Y0-0000000000000000-0-0] [lt=24] submit log success(service_type_=0, last_id=1719219554521932000, limited_id=1719219554521932000) [2024-06-24 16:58:57.880182] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [162401][TsMgr][T1003][Y0-0000000000000000-0-0] [lt=16] submit log with lock success(service_type_=0, last_id=1719219554521932000, limited_id=1719219554521932000) [2024-06-24 16:58:57.880207] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=11] gts statistics(tenant_id=1003, gts_rpc_cnt=10, get_gts_cache_cnt=399, get_gts_with_stc_cnt=66, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:57.880504] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:755) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1719219554521932000, latest_scn={val:1719219537880028001, v:0}, *this={tenant_id:1003, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216953754927000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213356439405009, v:0}, all_id_meta:{id_meta:[{limited_id:1719219554521932000, latest_log_ts:{val:1719219537880028001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213354637303002, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213354521932003, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}) [2024-06-24 16:58:57.880581] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:189) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=75] handle submit callback(service_type_=0, success=true, used_ts=416, log_ts={val:1719219537880028001, v:0}, limited_id=1719219554521932000) [2024-06-24 16:58:57.880605] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:561) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=22] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2024-06-24 16:58:57.880636] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:599) [1570][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=30] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2024-06-24 16:58:57.881302] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=16729, mem_used=103987200) [2024-06-24 16:58:57.885660] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=12, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=402, avg_log_submit_to_slide_time=415) [2024-06-24 16:58:57.890495] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.902213] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB5A-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:57.905483] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB5C-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.908728] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:306) [162970][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=33] ====== traversal_flush timer task ====== [2024-06-24 16:58:57.908977] INFO [MDS] flush (mds_table_mgr.cpp:172) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CD-0-0] [lt=25] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f47b684c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216859633263000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213322615298000, v:0}, all_id_meta:{id_meta:[{limited_id:1719219548711542000, latest_log_ts:{val:1719219532131098001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213288356113003, v:0}}, {limited_id:10000001, latest_log_ts:{val:1719213258713661001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f47d2ac6030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:57.909101] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:338) [162970][T1_Flush][T1][YB42AC141156-00061B9D88A0C5CD-0-0] [lt=116] succeed to traversal_flush(ret=0, ls_cnt=1) [2024-06-24 16:58:57.911299] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10787F7-0-0] [lt=45][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.912700] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=23] gc stale ls task succ [2024-06-24 16:58:57.914344] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB69-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:57.917616] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10787FC-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:57.934786] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1719219537933790000, start_id=1719219537933790000, end_id=1719219537933790001) [2024-06-24 16:58:57.934872] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3413, avg_group_log_size=379) [2024-06-24 16:58:57.934900] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=3412) [2024-06-24 16:58:57.943674] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04380B-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4814, pos=2770, bitmap=NULL) [2024-06-24 16:58:57.946898] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB94-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:57.951615] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB98-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:57.954445] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=55][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:57.954556] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:57.954778] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:57.954854] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:57.955026] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:57.955106] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:57.955210] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAB9C-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:57.961318] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219537961259000, start_id=1719219537961259000, end_id=1719219537961259001) [2024-06-24 16:58:57.966274] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.968121] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078833-0-0] [lt=47][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:57.973152] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219537972858000, start_id=1719219537972858000, end_id=1719219537972858001) [2024-06-24 16:58:57.980485] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107883F-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1719219537980257000, start_id=1719219537980257000, end_id=1719219537980257001) [2024-06-24 16:58:57.980589] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107883F-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=7169, avg_group_log_size=448) [2024-06-24 16:58:57.980637] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA107883F-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7169) [2024-06-24 16:58:57.980987] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7169) [2024-06-24 16:58:57.981035] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=7169) [2024-06-24 16:58:57.981063] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=39, avg_log_gen_to_submit_time=48, avg_log_submit_to_flush_time=398, avg_log_submit_to_slide_time=409) [2024-06-24 16:58:57.989971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283429662720, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:57.990553] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:57.992393] INFO [SERVER] reload_tenant_task (ob_tenant_tablet_ttl_mgr.cpp:1296) [1971][T1004_TTLTablet][T1004][YB42AC141156-00061B9D9A50C34C-0-0] [lt=32] finish reload tenant task(local_tenant_task_={tenant_id:1004, task_id:-1, is_usr_trigger:false, need_check:false, is_dirty:false, ttl_continue:true, rsp_time:-1, state:4, is_reused:true}, tenant_task={gmt_create:0, gmt_modified:0, tenant_id:18446744073709551615, table_id:18446744073709551615, tablet_id:18446744073709551615, task_id:0, task_start_time:0, task_update_time:0, trigger_type:0, status:19, ttl_del_cnt:0, max_version_del_cnt:0, scan_cnt:0, row_key:"", ret_code:"OB_SUCCESS"}, is_leader=true) [2024-06-24 16:58:57.998367] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1719219537998203000, start_id=1719219537998203000, end_id=1719219537998203001) [2024-06-24 16:58:58.000943] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [163716][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=49] LogLoopThread round_cost_time(us)(round_cost_time=20) [2024-06-24 16:58:58.004031] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:58.009580] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AABF0-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:58.012820] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078868-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:58.020767] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1719219538020392000, start_id=1719219538020392000, end_id=1719219538020392001) [2024-06-24 16:58:58.023966] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:256) [1610][T1003_ArcSender][T1003][YB42AC141156-00061B9D9420C0E5-0-0] [lt=33][errcode=-4018] try free send task failed(ret=-4018) [2024-06-24 16:58:58.046032] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1719219528043990, end_time=1719219538046029, dag_status={}) [2024-06-24 16:58:58.046070] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046096] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046112] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046127] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046141] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046156] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046170] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046184] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046198] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2818) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2024-06-24 16:58:58.046212] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046232] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046250] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046266] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046298] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046314] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046330] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046346] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:7, dag_type_str:"WRITE_CKPT", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046448] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046484] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046500] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046533] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046549] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046565] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046581] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046597] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046613] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046643] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046656] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046674] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046690] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046705] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046724] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046772] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046837] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046853] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046868] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046884] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046915] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046931] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046964] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046977] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.046993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047009] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047024] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047073] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047089] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047105] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047120] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047136] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047152] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4252) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2024-06-24 16:58:58.047168] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3583) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2024-06-24 16:58:58.047182] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2024-06-24 16:58:58.047196] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2024-06-24 16:58:58.047209] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2024-06-24 16:58:58.047220] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2024-06-24 16:58:58.047231] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2024-06-24 16:58:58.047242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2024-06-24 16:58:58.047253] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2024-06-24 16:58:58.047264] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2024-06-24 16:58:58.047275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3586) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2024-06-24 16:58:58.047287] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4271) [909][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt=43, total_running_task_cnt=0, work_thread_num=43, scheduled_task_cnt=0) [2024-06-24 16:58:58.055024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-06-24 16:58:58.057118] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=24] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:58.066331] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.072800] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAC3D-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:58.078518] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 364.50) [2024-06-24 16:58:58.078550] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:58.078656] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 374.50) [2024-06-24 16:58:58.078670] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:58.078696] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078712] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078724] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078736] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078747] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078758] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078766] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=7] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078778] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078790] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078801] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078812] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078823] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078834] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078845] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078857] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.078868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:58.079152] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:58.079188] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:58.079223] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:58.079567] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1226) [2024-06-24 16:58:58.079673] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=20] [APPLY STAT CB APPEND COST TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=35, this=0x7f46d7ab8280, extra_info="") [2024-06-24 16:58:58.079697] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=23] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=453, this=0x7f46d7ab84b0, extra_info="") [2024-06-24 16:58:58.079713] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=0, this=0x7f46d7ab86e0, extra_info="") [2024-06-24 16:58:58.079732] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=-518, this=0x7f46d7ab8910, extra_info="") [2024-06-24 16:58:58.079746] INFO [LIB] stat (utility.h:1165) [1404][T1004_ApplySrv1][T1004][YB42AC141156-00061B9D997125C7-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=13, stat_interval=5000000, avg (count/cost)=-28, this=0x7f46d7ab8b40, extra_info="") [2024-06-24 16:58:58.079818] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=413, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:58.079860] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:58.079898] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=450, avg_log_submit_to_slide_time=462) [2024-06-24 16:58:58.088554] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1719219538088552, bytes: 171165182, bw: 0.018589 MB/s, add_ts: 1007618, add_bytes: 19640 [2024-06-24 16:58:58.090612] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.091145] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=29] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16525, offset=3766407}, end_cursor:ObLogCursor{file_id=1, log_id=16526, offset=3766680}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9db4050, len:1913, log_data_len:273, seq:16525, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:58.092936] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC45-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103434184303, cache_obj->added_lc()=false, cache_obj->get_object_id()=9384, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:58.094248] WDIAG get_refactored (ob_hashtable.h:1102) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC47-0-0] [lt=30][errcode=-4201] hashtable not init [2024-06-24 16:58:58.094269] WDIAG [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1422) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D8B70FC47-0-0] [lt=19][errcode=-4016] get cursor info failed(cursor_id=1155, get_sessid()=3221489125) [2024-06-24 16:58:58.094407] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163026][T1_L0_G0][T1][YB42AC141156-00061B9D8820FB8A-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219538094376000, start_id=1719219538094376000, end_id=1719219538094376001) [2024-06-24 16:58:58.095112] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D911-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1719219538094376000, start_id=1719219538094376000, end_id=1719219538094376001) [2024-06-24 16:58:58.095208] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D911-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7892, avg_group_log_size=607) [2024-06-24 16:58:58.095236] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D911-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7892) [2024-06-24 16:58:58.095521] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=9] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7892) [2024-06-24 16:58:58.095557] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7892) [2024-06-24 16:58:58.095589] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=372, avg_log_submit_to_slide_time=381) [2024-06-24 16:58:58.096216] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=34] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16526, offset=3766680}, end_cursor:ObLogCursor{file_id=1, log_id=16527, offset=3766945}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9db8050, len:1640, log_data_len:265, seq:16526, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:58.096520] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096606] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096636] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096653] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096648] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096760] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096820] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096855] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096860] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096864] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.096865] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097076] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097153] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097202] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=15] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097269] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097309] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097443] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097561] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097641] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=7] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097651] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=12] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097654] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097658] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097667] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097678] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097824] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097862] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.097881] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098010] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098127] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098297] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098432] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098434] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098441] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098564] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098610] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098619] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=13] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098648] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098685] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098687] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098695] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098730] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.098949] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1459, mem_used=4159488) [2024-06-24 16:58:58.098991] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.099649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.107023] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=56] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1001, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:74697, max_lsn:57999438, max_scn:{val:1719219537880028001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:57999438}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16056398}}, last_submit_lsn:{lsn:57999316}, last_submit_end_lsn:{lsn:57999438}, last_submit_log_id:74697, last_submit_log_pid:1, max_flushed_lsn:{lsn:57999316}, max_flushed_end_lsn:{lsn:57999438}, max_flushed_log_pid:1, committed_end_lsn:{lsn:57999438}, last_slide_log_id:74697, last_slide_scn:{val:1719219537880028001, v:0}, last_slide_lsn:{lsn:57999316}, last_slide_end_lsn:{lsn:57999438}, last_slide_log_pid:1, last_slide_log_accum_checksum:1130704270, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f46d2f88530}, [StateMgr]={this:0x7f46d2f8c2b0, self:"172.20.17.86:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:74698, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213376431572, palf_role_change_cb:0x7f46d2f92cb0, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f46d2f89c70}, [ModeMgr]={palf_id:1001, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1719213369678630002, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1719213369678630001, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1719213369678630001, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/meta", dir_fd:689, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f46d2f8e478, flashback_version:0}, log_storage:{log_tail:{lsn:57999438}, readable_log_tail:{lsn:57999438}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:0}, min_scn:{val:1719213369678630002, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/data/1/clog/tenant_1004/1001/log", dir_fd:690, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:9105330, block_header_serialize_buf_:0x7f46d2f90138, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1719213376431519, this:0x7f46d2f8c9f0}, [Reconfirm]={palf_id:1001, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213376432460, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f46d2f8c430}) [2024-06-24 16:58:58.107196] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=170] [PALF_DUMP](palf_id=1001, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219538079855, last_flushed_end_lsn:{lsn:57999438}}]) [2024-06-24 16:58:58.107208] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [1206][T1004_LogLoop][T1004][Y0-0000000000000000-0-0] [lt=10] current log_task status(palf_id=1001, self="172.20.17.86:2882", log_id=74698, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219538079855, last_flushed_end_lsn:{lsn:57999438}}]) [2024-06-24 16:58:58.112988] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:58.113013] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=18] get_disk_usage(ret=0, capacity(MB):=4915, used(MB):=134) [2024-06-24 16:58:58.113043] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [1602][T1003_CKClogDis][T1003][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=73704248, threshold=1546188226, need_update_checkpoint_scn=false) [2024-06-24 16:58:58.117157] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD28-0-0] [lt=17] [RS_MGR] force set rs list(master_rs="172.20.17.86:2882") [2024-06-24 16:58:58.117182] INFO [SERVER] handle_heartbeat (ob_service.cpp:3250) [163137][T1_L0_G0][T1][YB42AC141156-00061B9D88E0CD28-0-0] [lt=18] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"172.20.17.86:2882", server_id:1, rs_addr:"172.20.17.86:2882", rs_server_status:1, epoch_id:1}, hb_response={zone:"zone1", server:"172.20.17.86:2882", sql_port:2881, build_version:"4.3.1.0_100000032024051615-bad90e897a7f0f56b8ce5c43e186aa8f4bab03c4(May 16 2024 17:21:43)", start_service_time:1719213306412144, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=26) [2024-06-24 16:58:58.135002] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719219538134102000, start_id=1719219538134102000, end_id=1719219538134102001) [2024-06-24 16:58:58.135865] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=13] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:58.161151] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219538160476000, start_id=1719219538160476000, end_id=1719219538160476001) [2024-06-24 16:58:58.166392] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.173111] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219538173073000, start_id=1719219538173073000, end_id=1719219538173073001) [2024-06-24 16:58:58.174638] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:58.177046] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=26] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:58.179226] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1226, avg_group_log_size=122) [2024-06-24 16:58:58.179254] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1226) [2024-06-24 16:58:58.179291] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:58.179582] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:58.179605] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:58.179638] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=469, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:58.179676] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:58.183720] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EE-0-0] [lt=9] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:58.183739] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EE-0-0] [lt=17] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:58.185478] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1913, avg_group_log_size=191) [2024-06-24 16:58:58.185511] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1913) [2024-06-24 16:58:58.186864] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D909-0-0] [lt=17] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:58.186897] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D909-0-0] [lt=30] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:58.190474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283429662720, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:58.190678] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:58.190705] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"172.20.17.86:2882", switch_to_leader_ts:-1}) [2024-06-24 16:58:58.190723] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.198502] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219538198440000, start_id=1719219538198440000, end_id=1719219538198440001) [2024-06-24 16:58:58.202711] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:58.220842] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219538220599000, start_id=1719219538220599000, end_id=1719219538220599001) [2024-06-24 16:58:58.250724] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:58.250762] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:58.251107] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:58.251139] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=375, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:58.251157] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=349, avg_log_submit_to_slide_time=361) [2024-06-24 16:58:58.251181] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:58.255075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-06-24 16:58:58.255783] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0438C0-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=181, pos=71, bitmap=NULL) [2024-06-24 16:58:58.256021] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0438C0-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=143, pos=66, bitmap=NULL) [2024-06-24 16:58:58.256484] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0438C0-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=75, pos=48, bitmap=NULL) [2024-06-24 16:58:58.256899] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0438C0-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=161, pos=142, bitmap=NULL) [2024-06-24 16:58:58.257149] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C0438C0-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=135, pos=71, bitmap=NULL) [2024-06-24 16:58:58.266451] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.279698] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1226) [2024-06-24 16:58:58.279729] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=722, avg_log_submit_to_slide_time=732) [2024-06-24 16:58:58.285496] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] tx gc loop thread is running(MTL_ID()=1002) [2024-06-24 16:58:58.285515] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] try gc retain ctx [2024-06-24 16:58:58.285541] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=7] get_max_applied_scn(scn={val:1719219537995032000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:32457801}, palf_committed_end_scn_:{val:1719219537995032000, v:0}, last_check_scn_:{val:1719219537995032000, v:0}, max_applied_cb_scn_:{val:1719219537995032000, v:0}}) [2024-06-24 16:58:58.285569] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719216936813980, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f4753cb94b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:58.285887] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:445) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:58.285918] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [163038][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=30] try reload schema success(schema_version=1719216858757240, refresh_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_ret=0) [2024-06-24 16:58:58.285921] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:261) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72D-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:58.285966] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:286) [162255][SerScheQueue0][T0][YB42AC141156-00061B9D89C0C72D-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}, schema_info={schema_version:1719216919372024, tenant_id:1004, sequence_id:1099511632059}) [2024-06-24 16:58:58.287520] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=108] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216939041208000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219535595990000, v:0}, tablet_change_checkpoint_scn:{val:1719213338984910027, v:0}, all_id_meta:{id_meta:[{limited_id:1719219546480480000, latest_log_ts:{val:1719219529824381001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213336537499005, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:58.289513] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=88] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215150797158000, v:0}, clog_base_lsn:{lsn:201314304}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219535595990000, v:0}, tablet_change_checkpoint_scn:{val:1719213749858983000, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f477d976030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:913330184, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:58.290691] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.293042] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=10] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2024-06-24 16:58:58.293074] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=28] start lib cache evict(tenant_id=1, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:58.293091] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=15] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=140509184, mem_limit=912680550, cache_obj_num=489, cache_node_num=488) [2024-06-24 16:58:58.293107] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:58.297006] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=528437248, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=545304576, wash_ratio=6, tenant_id=1001) [2024-06-24 16:58:58.297104] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=45] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2024-06-24 16:58:58.297133] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=27] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=12, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:58.297187] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=7516192768, total_alloc_size=0, tenant_work_area_memory_hold=2097152, tenant_work_area_max_size=375809638, max_wa_memory_size=373712486, tmp_max_wa_memory_size=373712486, pre_mem_target=373712486, remain_memory_size=373712486, ratio=0.000000000000000000e+00, alloc_ratio=0.000000000000000000e+00, hold_ratio=5.580357148796699987e-03, tenant_memory_hold=1606574080, washable_size=-2, max_workarea_memory_size=373712486, max_tenant_memory_size=5909618688, wash_ratio=6, tenant_id=1002) [2024-06-24 16:58:58.297291] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=46714060, calc_global_bound_size=1048576000000, mem_target_=373712486, wa_max_memory_size=373712486, profile_cnt_=2, total_memory_size=8217264, max_wa_size=373712486, avg_bound_size=186856243, max_bound_size=46714060, min_bound_size_=1048576) [2024-06-24 16:58:58.297307] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=16] timer to calc global bound size(ret=0, global_bound_size_=46714060, manual_calc_cnt_=417558, drift_size_=0, pre_drift_size=6120112, wa_max_memory_size=373712486, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=2, pre_profile_cnt_=2, pre_profile_cnt=2, calc_info.get_global_bound_size()=46714060, total_memory_size=8217264, cur_profile_cnt=2, calc_info.get_mem_target()=373712486, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:58.297357] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=17] trace max work area(auto_calc=true, tenant_max_memory_limit=1717986918, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=85899345, max_wa_memory_size=85899345, tmp_max_wa_memory_size=85899345, pre_mem_target=85899345, remain_memory_size=85899345, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=669392896, washable_size=-2, max_workarea_memory_size=85899345, max_tenant_memory_size=1048594022, wash_ratio=6, tenant_id=1003) [2024-06-24 16:58:58.297424] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=10737418, calc_global_bound_size=1048576000000, mem_target_=85899345, wa_max_memory_size=85899345, profile_cnt_=0, total_memory_size=0, max_wa_size=85899345, avg_bound_size=10737418, max_bound_size=10737418, min_bound_size_=1048576) [2024-06-24 16:58:58.297441] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1003][Y0-0000000000000000-0-0] [lt=16] timer to calc global bound size(ret=0, global_bound_size_=10737418, manual_calc_cnt_=6, drift_size_=0, pre_drift_size=0, wa_max_memory_size=85899345, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1003, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=10737418, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=85899345, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:58.297498] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:966) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=17] trace max work area(auto_calc=true, tenant_max_memory_limit=15461882266, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=773094113, max_wa_memory_size=773094113, tmp_max_wa_memory_size=773094113, pre_mem_target=773094113, remain_memory_size=773094113, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=1612541952, washable_size=-2, max_workarea_memory_size=773094113, max_tenant_memory_size=13849340314, wash_ratio=6, tenant_id=1004) [2024-06-24 16:58:58.297600] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:333) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=19] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=96636764, calc_global_bound_size=1048576000000, mem_target_=773094113, wa_max_memory_size=773094113, profile_cnt_=0, total_memory_size=0, max_wa_size=773094113, avg_bound_size=96636764, max_bound_size=96636764, min_bound_size_=1048576) [2024-06-24 16:58:58.297614] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1214) [162150][SqlMemTimer][T1004][Y0-0000000000000000-0-0] [lt=14] timer to calc global bound size(ret=0, global_bound_size_=96636764, manual_calc_cnt_=82, drift_size_=0, pre_drift_size=0, wa_max_memory_size=773094113, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1004, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=96636764, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=773094113, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2024-06-24 16:58:58.300465] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=489, alloc_obj_list=[{obj_id:42, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156328}, {obj_id:84, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175264}, {obj_id:85, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:86, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180723}, {obj_id:87, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186891}, {obj_id:88, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180247}, {obj_id:90, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180634}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176728}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183684}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:280167}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220989}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208404}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:497394}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:313801}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:699303}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:265654}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:476997}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:590717}, {obj_id:447, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1565537}, {obj_id:449, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1778630}, {obj_id:451, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216360}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216649}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220660}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:457750}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185651}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:328758}, {obj_id:462, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330648}, {obj_id:463, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192132}, {obj_id:464, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198533}, {obj_id:465, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212191}, {obj_id:466, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174566}, {obj_id:467, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201396}, {obj_id:468, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179405}, {obj_id:469, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214350}, {obj_id:471, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207104}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:253228}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195488}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174542}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177038}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:511021}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:320987}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260290}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312790}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252093}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195422}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175392}, {obj_id:502, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196342}, {obj_id:503, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175848}, {obj_id:504, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188853}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179605}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231777}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:509, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196626}, {obj_id:510, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173120}, {obj_id:511, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:311055}, {obj_id:513, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214894}, {obj_id:514, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235910}, {obj_id:516, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200147}, {obj_id:517, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220502}, {obj_id:518, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195280}, {obj_id:520, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202672}, {obj_id:521, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198849}, {obj_id:522, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192692}, {obj_id:523, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214166}, {obj_id:524, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199195}, {obj_id:525, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203230}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188543}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186379}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185082}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199961}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193940}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187918}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185249}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188273}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185281}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188266}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185217}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191628}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186782}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182746}, {obj_id:542, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210305}, {obj_id:543, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181048}, {obj_id:544, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182762}, {obj_id:546, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190879}, {obj_id:547, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187695}, {obj_id:548, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173600}, {obj_id:549, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183162}, {obj_id:550, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:551, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191496}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182858}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184042}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190982}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190656}, {obj_id:557, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186202}, {obj_id:558, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325989}, {obj_id:559, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263435}, {obj_id:563, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:315465}, {obj_id:564, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:252892}, {obj_id:566, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181297}, {obj_id:567, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191357}, {obj_id:568, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186182}, {obj_id:569, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190906}, {obj_id:570, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174865}, {obj_id:571, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192839}, {obj_id:572, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206906}, {obj_id:574, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216584}, {obj_id:575, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217160}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217966}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198328}, {obj_id:581, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:582, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:594, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187982}, {obj_id:600, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208020}, {obj_id:626, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189790}, {obj_id:627, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189906}, {obj_id:628, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173470}, {obj_id:630, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196432}, {obj_id:631, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:632, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:633, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216281}, {obj_id:647, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218357}, {obj_id:648, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173760}, {obj_id:649, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:650, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173729}, {obj_id:652, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:653, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173732}, {obj_id:654, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174976}, {obj_id:671, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:723, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:724, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180109}, {obj_id:725, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:726, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176856}, {obj_id:727, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177416}, {obj_id:728, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195054}, {obj_id:730, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173840}, {obj_id:742, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205566}, {obj_id:743, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188499}, {obj_id:744, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183386}, {obj_id:745, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182318}, {obj_id:746, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:747, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:748, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:749, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:750, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:751, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171280}, {obj_id:784, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196680}, {obj_id:791, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215872}, {obj_id:793, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181610}, {obj_id:794, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182682}, {obj_id:795, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184787}, {obj_id:796, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:797, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:798, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206520}, {obj_id:799, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:800, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199272}, {obj_id:801, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193379}, {obj_id:802, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:803, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188961}, {obj_id:804, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201543}, {obj_id:805, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192084}, {obj_id:806, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:807, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:808, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:809, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270373}, {obj_id:810, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190856}, {obj_id:811, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187100}, {obj_id:812, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177768}, {obj_id:813, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188713}, {obj_id:814, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181001}, {obj_id:815, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235375}, {obj_id:816, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232722}, {obj_id:817, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226698}, {obj_id:818, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227301}, {obj_id:819, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221585}, {obj_id:820, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230741}, {obj_id:821, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230876}, {obj_id:822, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178336}, {obj_id:823, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188423}, {obj_id:824, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:226491}, {obj_id:825, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193884}, {obj_id:826, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193724}, {obj_id:827, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199846}, {obj_id:828, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205244}, {obj_id:829, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:241253}, {obj_id:830, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221814}, {obj_id:831, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210824}, {obj_id:832, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210963}, {obj_id:833, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197806}, {obj_id:834, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211347}, {obj_id:835, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210603}, {obj_id:836, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209539}, {obj_id:837, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211715}, {obj_id:838, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177348}, {obj_id:839, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210259}, {obj_id:840, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209883}, {obj_id:841, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:262099}, {obj_id:842, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175493}, {obj_id:843, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205489}, {obj_id:844, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232689}, {obj_id:845, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185570}, {obj_id:846, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185514}, {obj_id:847, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220302}, {obj_id:848, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:331089}, {obj_id:849, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:232881}, {obj_id:850, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192517}, {obj_id:851, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:855, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206588}, {obj_id:856, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419853}, {obj_id:858, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:312866}, {obj_id:859, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:417515}, {obj_id:860, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:350058}, {obj_id:861, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281083}, {obj_id:862, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179286}, {obj_id:863, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191391}, {obj_id:864, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281084}, {obj_id:865, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219042}, {obj_id:866, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206554}, {obj_id:867, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208470}, {obj_id:868, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188900}, {obj_id:870, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219087}, {obj_id:875, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156217}, {obj_id:878, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156235}, {obj_id:881, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177853}, {obj_id:882, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176981}, {obj_id:883, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173808}, {obj_id:884, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215596}, {obj_id:885, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179311}, {obj_id:888, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210943}, {obj_id:889, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180215}, {obj_id:890, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214686}, {obj_id:891, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200921}, {obj_id:892, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316627}, {obj_id:893, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179476}, {obj_id:894, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191646}, {obj_id:895, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:896, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172512}, {obj_id:897, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:898, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175082}, {obj_id:899, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176744}, {obj_id:900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185980}, {obj_id:901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177024}, {obj_id:902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184722}, {obj_id:903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:419015}, {obj_id:906, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189591}, {obj_id:907, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195660}, {obj_id:908, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190465}, {obj_id:909, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202958}, {obj_id:912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184100}, {obj_id:913, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193338}, {obj_id:916, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180257}, {obj_id:917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187574}, {obj_id:918, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188984}, {obj_id:919, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186657}, {obj_id:920, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191343}, {obj_id:921, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:254259}, {obj_id:922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176828}, {obj_id:923, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174316}, {obj_id:924, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183833}, {obj_id:925, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233640}, {obj_id:926, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245003}, {obj_id:927, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290961}, {obj_id:928, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238513}, {obj_id:929, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228398}, {obj_id:930, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199433}, {obj_id:931, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200655}, {obj_id:932, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:247553}, {obj_id:933, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189077}, {obj_id:934, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242347}, {obj_id:935, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218127}, {obj_id:936, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:290957}, {obj_id:937, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181254}, {obj_id:938, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200703}, {obj_id:939, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186526}, {obj_id:942, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193003}, {obj_id:943, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206794}, {obj_id:952, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194284}, {obj_id:953, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208708}, {obj_id:961, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180578}, {obj_id:962, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231044}, {obj_id:965, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196830}, {obj_id:966, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212552}, {obj_id:979, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185459}, {obj_id:980, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234922}, {obj_id:981, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291345}, {obj_id:982, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:250102}, {obj_id:983, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228782}, {obj_id:984, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199840}, {obj_id:985, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246184}, {obj_id:986, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201055}, {obj_id:987, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291341}, {obj_id:988, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181606}, {obj_id:989, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201103}, {obj_id:992, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200633}, {obj_id:993, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218306}, {obj_id:996, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179008}, {obj_id:997, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185674}, {obj_id:1014, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214041}, {obj_id:1015, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179357}, {obj_id:1018, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181539}, {obj_id:1019, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189482}, {obj_id:1027, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281323}, {obj_id:1028, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219040}, {obj_id:1029, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206420}, {obj_id:1032, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196947}, {obj_id:1033, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191311}, {obj_id:1034, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176803}, {obj_id:1035, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185492}, {obj_id:1036, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179435}, {obj_id:1038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180786}, {obj_id:1040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196970}, {obj_id:1041, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185768}, {obj_id:1043, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196866}, {obj_id:1046, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174746}, {obj_id:1048, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156345}, {obj_id:1051, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195242}, {obj_id:1052, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172379}, {obj_id:1053, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:1054, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:1055, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:1068, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188778}, {obj_id:1092, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177175}, {obj_id:1151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:1152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199164}, {obj_id:1153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173770}, {obj_id:1154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:1155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:1156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:1184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192878}, {obj_id:1185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180252}, {obj_id:1186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183263}, {obj_id:1187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184448}, {obj_id:1188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194498}, {obj_id:1189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:1190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:167647}, {obj_id:1214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181270}, {obj_id:1216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193287}, {obj_id:1282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329169}, {obj_id:1285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231627}, {obj_id:1286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233448}, {obj_id:1287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201101}, {obj_id:1289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188270}, {obj_id:1290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:316293}, {obj_id:1292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183051}, {obj_id:1293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1294, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179882}, {obj_id:1295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172368}, {obj_id:1297, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184188}, {obj_id:1298, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185846}, {obj_id:1299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178233}, {obj_id:1300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177655}, {obj_id:1301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202647}, {obj_id:1303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251081}, {obj_id:1304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230662}, {obj_id:1305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191703}, {obj_id:1306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:246953}, {obj_id:1307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217355}, {obj_id:1309, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199868}, {obj_id:1310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276972}, {obj_id:1311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238590}, {obj_id:1312, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198828}, {obj_id:1315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205863}, {obj_id:1316, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203690}, {obj_id:1317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206067}, {obj_id:1318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206139}, {obj_id:1319, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187949}, {obj_id:1320, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198728}, {obj_id:1321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188689}, {obj_id:1322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218812}, {obj_id:1323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180666}, {obj_id:1324, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217497}, {obj_id:1325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:299269}, {obj_id:1326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197227}, {obj_id:1327, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204251}, {obj_id:1328, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192938}, {obj_id:1329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191870}, {obj_id:1332, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219465}, {obj_id:1333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206585}, {obj_id:1334, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206744}, {obj_id:1336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:1339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218736}, {obj_id:1345, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187036}, {obj_id:1357, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195512}, {obj_id:1358, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196531}, {obj_id:1371, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185597}, {obj_id:1376, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:293290}, {obj_id:1377, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191971}, {obj_id:1378, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185978}, {obj_id:1379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179887}, {obj_id:1380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:1381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1388, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193266}, {obj_id:1389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192206}, {obj_id:1418, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175639}, {obj_id:1419, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173568}, {obj_id:1426, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156291}, {obj_id:1427, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:340752}, {obj_id:1428, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179892}, {obj_id:1429, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213671}, {obj_id:1430, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:279596}, {obj_id:1431, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220431}, {obj_id:1432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187573}, {obj_id:1433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208798}, {obj_id:1434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197589}, {obj_id:1435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:1436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178987}, {obj_id:1437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:1443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:213609}, {obj_id:1658, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1659, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:1662, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1663, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176949}, {obj_id:1664, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174464}, {obj_id:1665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218026}, {obj_id:1900, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157084}, {obj_id:1901, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165488}, {obj_id:1902, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161397}, {obj_id:1903, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156371}, {obj_id:1904, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177639}, {obj_id:1911, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:275324}, {obj_id:1912, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205464}, {obj_id:1915, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234532}, {obj_id:1917, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:1922, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177855}, {obj_id:1990, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:308512}, {obj_id:1994, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184541}, {obj_id:2038, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239629}, {obj_id:2039, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183754}, {obj_id:2040, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184158}, {obj_id:2060, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204776}, {obj_id:2062, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270890}, {obj_id:2063, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195769}, {obj_id:2064, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:171680}, {obj_id:2065, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:2066, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183223}, {obj_id:2067, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172064}, {obj_id:2069, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175666}, {obj_id:2072, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196373}, {obj_id:2080, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183841}, {obj_id:2172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184711}, {obj_id:2173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181015}, {obj_id:2492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197364}, {obj_id:2641, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:428160}, {obj_id:2642, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224930}, {obj_id:2643, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:2752, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231243}, {obj_id:2753, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321410}, {obj_id:2754, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190987}, {obj_id:2755, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174849}, {obj_id:2756, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:272791}, {obj_id:2757, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854 [2024-06-24 16:58:58.302045] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [162854][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1577] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:58.308594] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAD2B-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:58.311698] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043903-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:58.317600] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10789A2-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:58.320819] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10789A3-0-0] [lt=48][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:58.323976] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10789A5-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:58.328358] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112702, mem_used=264127488) [2024-06-24 16:58:58.334937] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219538334722000, start_id=1719219538334722000, end_id=1719219538334722001) [2024-06-24 16:58:58.345256] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=33] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:58.349246] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10789D2-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:58.352423] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10789D4-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:58.357883] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA10789DB-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:58.360982] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:58.361088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:58.361271] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:58.361329] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:58.361407] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219538361147000, start_id=1719219538361147000, end_id=1719219538361147001) [2024-06-24 16:58:58.361476] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:58.361541] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:58.361676] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043943-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:58.366512] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.369960] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AADC5-0-0] [lt=41][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=14, len=331, pos=305, bitmap=NULL) [2024-06-24 16:58:58.370154] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AADC5-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=74, pos=60, bitmap=NULL) [2024-06-24 16:58:58.372753] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AADC7-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:58.373117] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [338][T1002_TenantWea][T1001][YB42AC141156-00061B9D903138A6-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.582890605926513672e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=379, Throttle Trigger(MB)=227, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.485425070768866362e+02) [2024-06-24 16:58:58.373279] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1719219538372750000, start_id=1719219538372750000, end_id=1719219538372750001) [2024-06-24 16:58:58.375319] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04394E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=134, pos=115, bitmap=NULL) [2024-06-24 16:58:58.379369] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:58.379402] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:58.380959] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219538380150000, start_id=1719219538380150000, end_id=1719219538380150001) [2024-06-24 16:58:58.381004] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=385, get_gts_with_stc_cnt=32, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=30, try_wait_gts_elapse_cnt=0) [2024-06-24 16:58:58.381028] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:58.385587] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:58.385636] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:58.385996] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=344, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:58.386026] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1089) [2024-06-24 16:58:58.386053] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:58.386061] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=5, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:58.386071] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=411, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:58.386076] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=22, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:58.390751] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.390985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283425468416, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:58.398601] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1719219538398126000, start_id=1719219538398126000, end_id=1719219538398126001) [2024-06-24 16:58:58.401354] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=24] LogLoopThread round_cost_time(us)(round_cost_time=14) [2024-06-24 16:58:58.412209] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AADFF-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:58.412681] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=820, pos=758, bitmap=NULL) [2024-06-24 16:58:58.412934] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=657, pos=131, bitmap=NULL) [2024-06-24 16:58:58.413028] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=21][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=994, pos=832, bitmap=NULL) [2024-06-24 16:58:58.413115] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=275, pos=137, bitmap=NULL) [2024-06-24 16:58:58.413268] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=216, pos=149, bitmap=NULL) [2024-06-24 16:58:58.413521] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=407, pos=135, bitmap=NULL) [2024-06-24 16:58:58.413615] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=1120, pos=964, bitmap=NULL) [2024-06-24 16:58:58.413710] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=17, len=425, pos=313, bitmap=NULL) [2024-06-24 16:58:58.413941] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=758, pos=662, bitmap=NULL) [2024-06-24 16:58:58.414026] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=148, pos=123, bitmap=NULL) [2024-06-24 16:58:58.414169] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=290, pos=134, bitmap=NULL) [2024-06-24 16:58:58.414242] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=20, len=931, pos=805, bitmap=NULL) [2024-06-24 16:58:58.414436] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=1200, pos=1181, bitmap=NULL) [2024-06-24 16:58:58.414511] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=366, pos=127, bitmap=NULL) [2024-06-24 16:58:58.414584] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=813, pos=130, bitmap=NULL) [2024-06-24 16:58:58.414703] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=810, pos=135, bitmap=NULL) [2024-06-24 16:58:58.414741] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAE01-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:58.414888] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=895, pos=130, bitmap=NULL) [2024-06-24 16:58:58.414964] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=959, pos=930, bitmap=NULL) [2024-06-24 16:58:58.415034] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=11, len=963, pos=957, bitmap=NULL) [2024-06-24 16:58:58.415107] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=7, len=942, pos=935, bitmap=NULL) [2024-06-24 16:58:58.415236] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=820, pos=126, bitmap=NULL) [2024-06-24 16:58:58.415309] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=915, pos=141, bitmap=NULL) [2024-06-24 16:58:58.415465] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=18, len=782, pos=775, bitmap=NULL) [2024-06-24 16:58:58.415541] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C04396E-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=6, len=214, pos=164, bitmap=NULL) [2024-06-24 16:58:58.420944] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219538420303000, start_id=1719219538420303000, end_id=1719219538420303001) [2024-06-24 16:58:58.423053] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=130016, mem_used=326519808) [2024-06-24 16:58:58.455165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-06-24 16:58:58.462742] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=8] ====== checkpoint timer task ====== [2024-06-24 16:58:58.464438] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=26] succ to get rec scn(*this={this:0x7f46d7804030, ls_id:{id:1}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719216919416455000, v:0}, last_push_gc_task_ts_:1719216963438727, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:664}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:58.464476] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=38] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae4080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719216963444091, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae4080, snapshot_version:{val:1719216963444091, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:58.464514] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=31] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:58.464641] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=21] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f46d7a04510, is_inited:true, freezing_scn:{val:1719215121678565000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719216964055431000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219535876558002, v:0}, tablet_change_checkpoint_scn:{val:1719213366075325004, v:0}, all_id_meta:{id_meta:[{limited_id:1719219553569925000, latest_log_ts:{val:1719219537378744001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213364071301002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:58.464736] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=91] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f46d7a041b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f46d7a120d0, memtable_head:2, memtable_tail:3, t3m:0x7f472851e030, tables:[null, null, 0x7f46d7ad4d90, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:1719215162427982, tx_data_table:0x7f46d7a13b90, ls_tablet_svr:0x7f46d7a04190}, min_rec_scn={val:1719216964055431000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:58.464776] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:58.464794] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=0, rec_log_ts={val:1719219537378744001, v:0}) [2024-06-24 16:58:58.464805] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=10] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:58.464826] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=7] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719216964055431000, v:0}, checkpoint_scn_in_ls_meta={val:1719216964055431000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:58.464849] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=14][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:58.464868] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:58.466411] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078A66-0-0] [lt=39][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:58.466499] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=12] succ to get rec scn(*this={this:0x7f46d78b6030, ls_id:{id:1001}, tenant_id:1004, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719213855894296000, v:0}, last_push_gc_task_ts_:1719215177375960, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:3587}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:58.466524] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=24] tx ctx memtable get rec scn(this={ObITable:{this:0x7f46d7ae5350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215177381999, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f46d7ae5350, snapshot_version:{val:1719215177381999, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:58.466549] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=23] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2024-06-24 16:58:58.466571] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.466742] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=16] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1719214335022870002, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:1152921504606847939}, rec_scn:{val:1719214335022870002, v:0}}, }, *this={this:0x7f46caf7c510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1004, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719213901901599001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1719219535876558002, v:0}, tablet_change_checkpoint_scn:{val:1719213863916790001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f471f2d8030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:58.466822] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=77] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f46caf8d790}, min_rec_scn={val:1719213901901599001, v:0}, ls_id_={id:1001}) [2024-06-24 16:58:58.466840] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1719213369678630001, v:0}) [2024-06-24 16:58:58.466856] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=13] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719213901901599001, v:0}, checkpoint_scn_in_ls_meta={val:1719213901901599001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2024-06-24 16:58:58.466870] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=11][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:58.466886] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2024-06-24 16:58:58.466896] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [1379][T1004_TxCkpt][T1004][Y0-0000000000000000-0-0] [lt=9] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2024-06-24 16:58:58.472260] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [162856][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2024-06-24 16:58:58.478203] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1916) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=8] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2024-06-24 16:58:58.478232] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1457) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=25] start lib cache evict(tenant_id=1001, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:58.478249] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1474) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=39845888, mem_limit=53687090, cache_obj_num=76, cache_node_num=76) [2024-06-24 16:58:58.478264] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2680) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:58.480607] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:104) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] tx gc loop thread is running(MTL_ID()=1001) [2024-06-24 16:58:58.480653] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:111) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] try gc retain ctx [2024-06-24 16:58:58.480677] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:748) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=9] get_max_applied_scn(scn={val:1719219538420303000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:1, palf_committed_end_lsn_:{lsn:70466641}, palf_committed_end_scn_:{val:1719219538420303000, v:0}, last_check_scn_:{val:1719219538420303000, v:0}, max_applied_cb_scn_:{val:1719219538420303000, v:0}}) [2024-06-24 16:58:58.480708] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1025) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=27] get_min_unreplayed_log_info in skip state(lsn={lsn:0}, scn={val:1, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1719215116081704, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:0, ret_code_:0}}, next_to_submit_lsn_:{lsn:0}, next_to_submit_scn_:{val:0, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1, v:0}, iterator_:{iterator_impl:{buf_:null, next_round_pread_size:3678208, curr_read_pos:0, curr_read_buf_start_pos:0, curr_read_buf_end_pos:0, log_storage_:{IteratorStorage:{start_lsn:{lsn:0}, end_lsn:{lsn:0}, read_buf:{buf_len_:0, buf_:null}, block_size:67104768, log_storage_:0x7f475534d4b0}, IteratorStorageType::"DiskIteratorStorage"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:18446744073709551615, v:3}, curr_entry:{LogEntryHeader:{magic:0, version:0, log_size:-1, scn_:{val:18446744073709551615, v:3}, data_checksum:0, flag:0}}, init_mode_version:0, accumulate_checksum:-1, curr_entry_is_padding:0, padding_entry_size:0, padding_entry_scn:{val:18446744073709551615, v:3}}, io_ctx:{user:"REPLAY", palf_id_:1, iterator_info_:{allow_filling_cache_:true, hit_cnt_:0, miss_cnt_:0, cache_read_size_:0, read_io_cnt_:0, read_io_size_:0, read_disk_cost_ts_:0, hit rate:"0.000000000000000000e+00", start_lsn_:{lsn:0}}}}}}) [2024-06-24 16:58:58.483019] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:253) [975][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=87] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219547830421000, latest_log_ts:{val:1719219531216126001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2024-06-24 16:58:58.483254] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=32] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:58.484362] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2399) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=11] Dumping All Cache Objs(alloc_obj_list.count()=76, alloc_obj_list=[{obj_id:8, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174304}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176484}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178482}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181132}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189765}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192298}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182448}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176653}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172864}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173920}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242576}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221090}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187998}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190550}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200448}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197840}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180103}, {obj_id:302, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183324}, {obj_id:306, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187764}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186177}, {obj_id:311, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188758}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190672}, {obj_id:316, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198012}, {obj_id:319, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179720}, {obj_id:322, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192166}, {obj_id:324, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196314}, {obj_id:331, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178850}, {obj_id:342, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219292}, {obj_id:343, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216775}, {obj_id:346, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178979}, {obj_id:348, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172576}, {obj_id:374, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:296581}, {obj_id:663, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187857}, {obj_id:665, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172976}, {obj_id:670, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:465888}, {obj_id:671, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:461383}, {obj_id:672, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:1306198}, {obj_id:676, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195264}, {obj_id:677, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186909}, {obj_id:678, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198285}, {obj_id:679, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189892}, {obj_id:680, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193214}, {obj_id:681, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193891}, {obj_id:682, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187070}, {obj_id:683, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197640}, {obj_id:684, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201625}, {obj_id:685, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178069}, {obj_id:686, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177148}, {obj_id:687, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194525}, {obj_id:688, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181308}, {obj_id:689, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198802}, {obj_id:690, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175637}, {obj_id:691, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:692, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179407}, {obj_id:693, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187919}, {obj_id:694, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178380}, {obj_id:695, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225844}, {obj_id:696, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224627}, {obj_id:697, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196824}, {obj_id:698, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191032}, {obj_id:699, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189456}, {obj_id:700, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:701, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172640}, {obj_id:702, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176296}, {obj_id:703, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172736}, {obj_id:704, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173696}, {obj_id:705, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175362}, {obj_id:706, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:249821}, {obj_id:707, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225808}, {obj_id:708, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173723}, {obj_id:709, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:710, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197090}, {obj_id:711, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185928}, {obj_id:712, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:214053}, {obj_id:713, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242170}, {obj_id:714, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198804}]) [2024-06-24 16:58:58.484648] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2688) [854][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=283] schedule next cache evict task(evict_interval=5000000) [2024-06-24 16:58:58.485678] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:58.485710] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:58.486009] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=364, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:58.486043] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=14, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:58.486050] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=4] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=5, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:58.486057] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=7] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=457, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:58.486061] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=4] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=18, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:58.490809] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.494726] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8BA-0-0] [lt=55][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:58.494751] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8BA-0-0] [lt=23][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0) [2024-06-24 16:58:58.535209] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219538534241000, start_id=1719219538534241000, end_id=1719219538534241001) [2024-06-24 16:58:58.535636] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=3972) [2024-06-24 16:58:58.535800] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1719219538334722000, v:0}, new_max_version={val:1719219538334722000, v:0}, last_min_version={val:1719219538134102000, v:0}, last_max_version={val:1719219538134102000, v:0}, total_time_us=2610, delta_us=201076) [2024-06-24 16:58:58.561553] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219538560673000, start_id=1719219538560673000, end_id=1719219538560673001) [2024-06-24 16:58:58.562101] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1003, current_version={val:1719219538361147000, v:0}, min_version={val:1719219538361147000, v:0}, max_version={val:1719219538361147000, v:0}, in_service=true, leader_epoch=1) [2024-06-24 16:58:58.566636] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.573719] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719219538573360000, start_id=1719219538573360000, end_id=1719219538573360001) [2024-06-24 16:58:58.573793] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f4755347470, extra_info="") [2024-06-24 16:58:58.573826] INFO [LIB] stat (utility.h:1165) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f475531b210, extra_info="id:1") [2024-06-24 16:58:58.574203] INFO [LIB] stat (utility.h:1165) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=349, this=0x7f47553514f0, extra_info="palf_id:1") [2024-06-24 16:58:58.574234] INFO [LIB] stat (utility.h:1182) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f4760ea8530, extra_info="") [2024-06-24 16:58:58.574253] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f47553476a0, extra_info="palf_id:1") [2024-06-24 16:58:58.574275] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=409, this=0x7f47553478d0, extra_info="palf_id:1") [2024-06-24 16:58:58.574291] INFO [LIB] stat (utility.h:1165) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=26, this=0x7f4755351720, extra_info="palf_id:1") [2024-06-24 16:58:58.575939] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [163805][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=56] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:954, free_obj_hold_cnt:287, allocator used:4934216, allocator total:5101824}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:287, free_obj_hold_cnt:9, allocator used:19414936, allocator total:19414936}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():123008, full allocator used:1600, full allocator total:188544}, tablets_mem=24705304, tablets_mem_limit=1503238540, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:125, free_obj_hold_cnt:159, allocator used:581632, allocator total:654080}, pending_cnt=0, wait_gc_count=0, tablet count=1241) [2024-06-24 16:58:58.590869] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.591457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283425468416, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:58.599091] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219538598689000, start_id=1719219538598689000, end_id=1719219538598689001) [2024-06-24 16:58:58.598320] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1933] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:4, max_cpu:4, memory_size:"2GB", log_disk_size:"17GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213256244734, is_removed:false}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:66, min_worker_cnt:42, max_worker_cnt:150, stopped:0, worker_us:368870892, recv_hp_rpc_cnt:3243, recv_np_rpc_cnt:3448, recv_lp_rpc_cnt:0, recv_mysql_cnt:32357, recv_task_cnt:51, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:25017006, workers:42, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=128 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:25126, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213256365800}{group_id:10, queue_size:0, recv_req_cnt:6275, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213261360250}{group_id:20, queue_size:0, recv_req_cnt:965, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918743789}{group_id:15, queue_size:0, recv_req_cnt:13, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216919852802}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213258715738}{group_id:9, queue_size:0, recv_req_cnt:160, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213252335182}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=2, token_change_ts:1719213259025542, tenant_role:1}) [2024-06-24 16:58:58.599613] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [1378][T1004_TenantWea][T1004][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=1, start_service_tstamp_=1719213364149839, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2024-06-24 16:58:58.599536] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1215] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245340110, is_removed:false}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:81095403, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:1385, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:31244355, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1719213259035589, tenant_role:0}) [2024-06-24 16:58:58.600662] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1125] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", min_iops:10000, max_iops:50000, iops_weight:0}}, mode:0, create_timestamp:1719213245333314, is_removed:false}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:true, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:45258664, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:15621015, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1719213259048104, tenant_role:0}) [2024-06-24 16:58:58.601825] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1163] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"2.4GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:23982374, recv_hp_rpc_cnt:74, recv_np_rpc_cnt:6114, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2479954, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24852, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213325131824}{group_id:20, queue_size:0, recv_req_cnt:641, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215168816313}{group_id:5, queue_size:0, recv_req_cnt:22, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213327935283}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1719213324836532, tenant_role:1}) [2024-06-24 16:58:58.602981] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1156] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"7GB", log_disk_size:"21.6GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213324132591, is_removed:false}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:150, stopped:0, worker_us:6457121142, recv_hp_rpc_cnt:2104, recv_np_rpc_cnt:7, recv_lp_rpc_cnt:0, recv_mysql_cnt:17644587, recv_task_cnt:354, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:43705641, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49578, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213333985763}{group_id:20, queue_size:0, recv_req_cnt:1946, min_worker_cnt:4, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719215769388477}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918841349}, rpc_stat_info: pcode=0x150a:cnt=40 pcode=0x150b:cnt=40, token_change_ts:1719213324547495, tenant_role:1}) [2024-06-24 16:58:58.604140] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1159] dump tenant info(tenant={id:1003, tenant_meta:{unit:{tenant_id:1003, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1.6GB", log_disk_size:"4.8GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1003, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:27580701, recv_hp_rpc_cnt:57, recv_np_rpc_cnt:6089, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:2469866, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=3 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:24744, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213351914771}{group_id:20, queue_size:0, recv_req_cnt:564, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216369834163}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1719213354638840}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=9, token_change_ts:1719213351641415, tenant_role:1}) [2024-06-24 16:58:58.605259] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2412) [162584][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=1119] dump tenant info(tenant={id:1004, tenant_meta:{unit:{tenant_id:1004, unit_id:1002, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1002, name:"ocp_monitor_unit", resource:{min_cpu:4, max_cpu:4, memory_size:"14.4GB", log_disk_size:"43.2GB", min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:4}}, mode:0, create_timestamp:1719213350827649, is_removed:false}, super_block:{tenant_id:1004, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:[-1](ver=0,mode=0,seq=0), tablet_meta_entry:[-1](ver=0,mode=0,seq=0), is_hidden:false, version:3, snapshot_cnt:0}, create_status:1}, unit_min_cpu:"4.000000000000000000e+00", unit_max_cpu:"4.000000000000000000e+00", total_worker_cnt:30, min_worker_cnt:18, max_worker_cnt:184, stopped:0, worker_us:185367553, recv_hp_rpc_cnt:5103, recv_np_rpc_cnt:1397, recv_lp_rpc_cnt:0, recv_mysql_cnt:40557, recv_task_cnt:15, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:9913149, workers:18, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:2, queue_size:0, recv_req_cnt:49362, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:4, nesting_worker_cnt:0, token_change:1719213361134602}{group_id:20, queue_size:0, recv_req_cnt:3494, min_worker_cnt:4, max_worker_cnt:184, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216969504568}{group_id:15, queue_size:0, recv_req_cnt:1, min_worker_cnt:2, max_worker_cnt:2, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1719216918851855}, rpc_stat_info: pcode=0x150a:cnt=40 pcode=0x150b:cnt=40, token_change_ts:1719217153282307, tenant_role:1}) [2024-06-24 16:58:58.615954] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [163739][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:58.620765] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1719219538619798000, start_id=1719219538619798000, end_id=1719219538619798001) [2024-06-24 16:58:58.622209] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1384][T1004_LSArchive][T1004][YB42AC141156-00061B9D9340C0E5-0-0] [lt=28] gc stale ls task succ [2024-06-24 16:58:58.622604] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [974][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=20] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:58.632796] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAF3F-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:58.635362] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAF41-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:58.640896] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAF49-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:58.643416] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAF4B-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:58.646096] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAF4D-0-0] [lt=24][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:58.651283] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=9] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=3972) [2024-06-24 16:58:58.655255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-06-24 16:58:58.661135] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:790) [162833][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=59] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):17408, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):115, sequence:2}) [2024-06-24 16:58:58.665583] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [163028][T1_L0_G0][T1][YB42AC141156-00061B9D9CE0C117-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=42103434756945, cache_obj->added_lc()=false, cache_obj->get_object_id()=9385, cache_obj->get_tenant_id()=1, lbt()="0x17a30451 0xc2aface 0x60012d3 0x5c32254 0x5c2b6ce 0x18b90701 0x5c24fb0 0x5c1f72a 0xb3c3824 0x17b1814e 0x7f484ccb7e25 0x7f484c9e534d") [2024-06-24 16:58:58.666693] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.675826] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B38-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:58.678939] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B39-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:58.679954] INFO [LIB] stat (utility.h:1165) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=378, this=0x7f46d7a514f0, extra_info="palf_id:1") [2024-06-24 16:58:58.679984] INFO [LIB] stat (utility.h:1182) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2de530, extra_info="") [2024-06-24 16:58:58.680001] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f46d7a476a0, extra_info="palf_id:1") [2024-06-24 16:58:58.680031] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=460, this=0x7f46d7a478d0, extra_info="palf_id:1") [2024-06-24 16:58:58.680049] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=23, this=0x7f46d7a51720, extra_info="palf_id:1") [2024-06-24 16:58:58.684058] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAF84-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:58.687121] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:58.687239] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:58.687447] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=19][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:58.687515] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:58.687702] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:58.687787] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:58.687892] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B43-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:58.690927] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.699285] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043A39-0-0] [lt=13][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:58.701209] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [162974][T1_LSArchiveMgr][T1][YB42AC141156-00061B9D8730C0E5-0-0] [lt=14] gc stale ls task succ [2024-06-24 16:58:58.725824] INFO eloop_run (eloop.c:140) [162239][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1719219538725821, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-06-24 16:58:58.731835] INFO do_work (ob_rl_mgr.cpp:705) [162253][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=23] swc wakeup.(stat_period_=1000000, ready=false) [2024-06-24 16:58:58.731935] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=27] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13774, offset=3460200}, end_cursor:ObLogCursor{file_id=1, log_id=13775, offset=3460473}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9dbc050, len:920, log_data_len:273, seq:13774, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:58.734910] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219538733930000, start_id=1719219538733930000, end_id=1719219538733930001) [2024-06-24 16:58:58.735294] INFO [LIB] stat (utility.h:1165) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=312, this=0x7f47b68934f0, extra_info="palf_id:1") [2024-06-24 16:58:58.735315] INFO [LIB] stat (utility.h:1182) [162831][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f47d61ffdb0, extra_info="") [2024-06-24 16:58:58.735371] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D921-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219538734987000, start_id=1719219538734987000, end_id=1719219538734987001) [2024-06-24 16:58:58.735450] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D921-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7888, avg_group_log_size=606) [2024-06-24 16:58:58.735475] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [163725][T1002_TeRec][T1001][YB42AC141156-00061B9D8CC0D921-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7888) [2024-06-24 16:58:58.735819] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [823][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7888) [2024-06-24 16:58:58.735865] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7888) [2024-06-24 16:58:58.735881] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [822][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=383, avg_log_submit_to_slide_time=392) [2024-06-24 16:58:58.736436] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [163807][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=13775, offset=3460473}, end_cursor:ObLogCursor{file_id=1, log_id=13776, offset=3460738}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9dc0050, len:647, log_data_len:265, seq:13775, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:58.741236] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AAFD9-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4797, pos=2787, bitmap=NULL) [2024-06-24 16:58:58.744368] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078B78-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:58.750529] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:519) [162921][T1_HBService][T1][YB42AC141156-00061B9D88F0CD5C-0-0] [lt=26] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2024-06-24 16:58:58.761679] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219538761437000, start_id=1719219538761437000, end_id=1719219538761437001) [2024-06-24 16:58:58.766757] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.773836] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719219538773075000, start_id=1719219538773075000, end_id=1719219538773075001) [2024-06-24 16:58:58.774305] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB APPEND COST TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=34, this=0x7f47553b8280, extra_info="") [2024-06-24 16:58:58.774335] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=29] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=416, this=0x7f47553b84b0, extra_info="") [2024-06-24 16:58:58.774352] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=0, this=0x7f47553b86e0, extra_info="") [2024-06-24 16:58:58.774370] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=-543, this=0x7f47553b8910, extra_info="") [2024-06-24 16:58:58.774385] INFO [LIB] stat (utility.h:1165) [929][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB TOTAL TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=-92, this=0x7f47553b8b40, extra_info="") [2024-06-24 16:58:58.786227] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=3] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1089) [2024-06-24 16:58:58.790986] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.791962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283425468416, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:58.799123] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1719219538798459000, start_id=1719219538798459000, end_id=1719219538798459001) [2024-06-24 16:58:58.799200] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1dbd470, extra_info="") [2024-06-24 16:58:58.799234] INFO [LIB] stat (utility.h:1165) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f46f1d89210, extra_info="id:1") [2024-06-24 16:58:58.799514] INFO [LIB] stat (utility.h:1165) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=293, this=0x7f46f1dc74f0, extra_info="palf_id:1") [2024-06-24 16:58:58.799526] INFO [LIB] stat (utility.h:1182) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=9] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=10, this=0x7f4700bfe530, extra_info="") [2024-06-24 16:58:58.799554] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=6, this=0x7f46f1dbd6a0, extra_info="palf_id:1") [2024-06-24 16:58:58.799586] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=346, this=0x7f46f1dbd8d0, extra_info="palf_id:1") [2024-06-24 16:58:58.799604] INFO [LIB] stat (utility.h:1165) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=24, this=0x7f46f1dc7720, extra_info="palf_id:1") [2024-06-24 16:58:58.801656] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2676) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", [SlidingWindow]={palf_id:1, self:"172.20.17.86:2882", lsn_allocator:{max_log_id:91490, max_lsn:70470399, max_scn:{val:1719219538773075000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:0}, reuse_lsn:{lsn:70470399}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:28527359}}, last_submit_lsn:{lsn:70469809}, last_submit_end_lsn:{lsn:70470399}, last_submit_log_id:91490, last_submit_log_pid:1, max_flushed_lsn:{lsn:70469809}, max_flushed_end_lsn:{lsn:70470399}, max_flushed_log_pid:1, committed_end_lsn:{lsn:70470399}, last_slide_log_id:91490, last_slide_scn:{val:1719219538773075000, v:0}, last_slide_lsn:{lsn:70469809}, last_slide_end_lsn:{lsn:70470399}, last_slide_log_pid:1, last_slide_log_accum_checksum:3932944358, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f4755346530}, [StateMgr]={this:0x7f475534a2b0, self:"172.20.17.86:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, leader:"172.20.17.86:2882", leader_epoch:0, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:91491, is_changing_config_with_arb:false, reconfirm_start_time_us:1719213327209529, palf_role_change_cb:0x7f4755350cb0, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"172.20.17.86:2882", alive_paxos_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, reconfig_barrier:{prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_end_lsn:{lsn:0}, prev_mode_pid:1}, persistent_config_version:{proposal_id:1, config_seq:2}, ms_ack_list:0, resend_config_version:{proposal_id:1, config_seq:2}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f4755347c70}, [ModeMgr]={palf_id:1, self:"172.20.17.86:2882", applied_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:1}, log_config_meta:{version:3, proposal_id:1, prev:{version:1, config:{config_version:{proposal_id:0, config_seq:1}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:1, config_seq:2}, log_sync_memberlist:1{server:"172.20.17.86:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:9223372036854775807, prev_lsn:{lsn:0}, prev_mode_pid:1}, log_snapshot_meta:{version:1, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:1, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:20480}, readable_log_tail:{lsn:20480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:134209536}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/meta", dir_fd:666, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67084288, block_header_serialize_buf_:0x7f475534c478, flashback_version:0}, log_storage:{log_tail:{lsn:70470399}, readable_log_tail:{lsn:70470399}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:1719219133216967001, v:0}, curr_block_id:1, palf_id:1}, block_mgr:{log_dir:"/data/1/clog/tenant_1001/1/log", dir_fd:667, min_block_id:0, max_block_id:2, curr_writable_block_id:1}, logical_block_size_:67104768, curr_block_writable_size_:63739137, block_header_serialize_buf_:0x7f475534e138, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1719213327209030, this:0x7f475534a9f0}, [Reconfirm]={palf_id:1, self:"172.20.17.86:2882", state:"FINISHED", new_proposal_id:1, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"172.20.17.86:2882", majority_max_accept_pid:9223372036854775807, majority_max_lsn:{lsn:0}, saved_end_lsn:{lsn:0}, last_submit_prepare_req_time_us:1719213327209993, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f475534a430}) [2024-06-24 16:58:58.802014] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2680) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=353] [PALF_DUMP](palf_id=1, self="172.20.17.86:2882", ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219538774263, last_flushed_end_lsn:{lsn:70470399}}]) [2024-06-24 16:58:58.802039] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4295) [827][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=21] current log_task status(palf_id=1, self="172.20.17.86:2882", log_id=91491, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"172.20.17.86:2882", timestamp:1, flag:0}, last_ack_time_us:1719219538774263, last_flushed_end_lsn:{lsn:70470399}}]) [2024-06-24 16:58:58.803619] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043A8C-0-0] [lt=36][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:58.813004] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:58.813030] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=19] get_disk_usage(ret=0, capacity(MB):=17408, used(MB):=115) [2024-06-24 16:58:58.813060] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [162971][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=16] cannot_recycle_log_size statistics(cannot_recycle_log_size=53545281, threshold=5476083302, need_update_checkpoint_scn=false) [2024-06-24 16:58:58.820856] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1719219538820631000, start_id=1719219538820631000, end_id=1719219538820631001) [2024-06-24 16:58:58.826719] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=33] new mysql sessid created(conn.sessid_=3221494490, support_ssl=false) [2024-06-24 16:58:58.826805] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221494490, sess.client_addr_="172.20.17.86:49550") [2024-06-24 16:58:58.826828] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1079) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f46ca5ced70, session_id:3221494490, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:58.826903] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:998) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=31][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f46ca5ced70, session_id:3221494490, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:58.826938] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=31] kill and revert session(conn.sessid_=3221494490, proxy_sessid=0, server_id=1, ret=0) [2024-06-24 16:58:58.826955] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:973) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f46ca5ced70, session_id:3221494490, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:807}, err:5, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2024-06-24 16:58:58.826979] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:223) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=22] mark session id unused(conn.sessid_=3221494490) [2024-06-24 16:58:58.826992] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [162502][sql_nio12][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221494490, proxy_sessid=0, tenant_id=0, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=false, ret=0, trace_id=Y0-0000000000000000-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:0], disconnect_state=0) [2024-06-24 16:58:58.828937] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:185) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=18] sql audit evict mem start(request_manager_->get_tenant_id()=1003, evict_low_mem_level=0, evict_high_mem_level=25769803, size_used=29, mem_used=49913856) [2024-06-24 16:58:58.828972] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:191) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=26] release old cannot free more memory [2024-06-24 16:58:58.828986] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1598][T1003_ReqMemEvi][T1003][Y0-0000000000000000-0-0] [lt=13] sql audit evict task end(request_manager_->get_tenant_id()=1003, evict_high_mem_level=25769803, evict_high_size_level=90000, evict_batch_count=1, elapse_time=50, size_used=0, mem_used=49913856) [2024-06-24 16:58:58.855343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-06-24 16:58:58.866811] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.873133] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162403][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.873590] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162408][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.873647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162414][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162402][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.873652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162424][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.873655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162420][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874015] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162419][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874030] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162411][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874103] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162416][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874133] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162413][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874132] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162418][RpcIO][T0][Y0-0000000000000000-0-0] [lt=13] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874205] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162425][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874289] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162427][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874436] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162405][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874441] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162407][RpcIO][T0][Y0-0000000000000000-0-0] [lt=17] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874444] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162417][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874529] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162404][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874533] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162426][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874543] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162421][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874641] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162422][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874642] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162415][RpcIO][T0][Y0-0000000000000000-0-0] [lt=16] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162412][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162410][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874649] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162409][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874681] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162406][RpcIO][T0][Y0-0000000000000000-0-0] [lt=18] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.874712] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162423][RpcIO][T0][Y0-0000000000000000-0-0] [lt=15] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:58.880050] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:58.881439] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [333][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=180388626, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=20077, mem_used=110226432) [2024-06-24 16:58:58.881839] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219538880896000, start_id=1719219538880896000, end_id=1719219538880896001) [2024-06-24 16:58:58.886245] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=9] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=406, avg_log_submit_to_slide_time=410) [2024-06-24 16:58:58.891044] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.912761] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [368][T1002_LSArchive][T1002][YB42AC141156-00061B9D8CE0C0E5-0-0] [lt=24] gc stale ls task succ [2024-06-24 16:58:58.934995] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219538934627000, start_id=1719219538934627000, end_id=1719219538934627001) [2024-06-24 16:58:58.961808] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219538960973000, start_id=1719219538960973000, end_id=1719219538960973001) [2024-06-24 16:58:58.966868] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.967215] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [856][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2024-06-24 16:58:58.973237] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB111-0-0] [lt=31][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:58.973942] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1719219538973663000, start_id=1719219538973663000, end_id=1719219538973663001) [2024-06-24 16:58:58.976475] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078C78-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:58.977127] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:58.982345] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078C7E-0-0] [lt=32][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4563, pos=3045, bitmap=NULL) [2024-06-24 16:58:58.985283] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB120-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:58.986025] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1670, avg_group_log_size=167) [2024-06-24 16:58:58.986058] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=2087) [2024-06-24 16:58:58.986361] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1670) [2024-06-24 16:58:58.986406] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1670) [2024-06-24 16:58:58.986419] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=9] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=446, avg_log_submit_to_slide_time=450) [2024-06-24 16:58:58.988110] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB122-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:58.991102] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:58.992442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283425468416, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:58.999279] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1719219538998986000, start_id=1719219538998986000, end_id=1719219538998986001) [2024-06-24 16:58:58.999563] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043B26-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1719219538998986000, start_id=1719219538998986000, end_id=1719219538998986001) [2024-06-24 16:58:59.004090] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [1605][T1003_LSArchive][T1003][YB42AC141156-00061B9D93F0C0E5-0-0] [lt=22] gc stale ls task succ [2024-06-24 16:58:59.005193] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:357) [162155][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=33] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=261347516416) [2024-06-24 16:58:59.013081] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB150-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219539012753000, start_id=1719219539012753000, end_id=1719219539012753001) [2024-06-24 16:58:59.013596] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [643][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C8BD271-0-0] [lt=34][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:59.016605] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB154-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:59.021116] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB158-0-0] [lt=42][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:59.021282] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1719219539021216000, start_id=1719219539021216000, end_id=1719219539021216001) [2024-06-24 16:58:59.023733] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:59.023839] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:59.024024] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:59.024088] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=16][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:59.024243] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:59.024319] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:59.024428] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB15B-0-0] [lt=14][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:59.034945] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078CC5-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:59.037245] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2024-06-24 16:58:59.037277] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] get_disk_usage(ret=0, capacity(MB):=22118, used(MB):=652) [2024-06-24 16:58:59.037323] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [353][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] cannot_recycle_log_size statistics(cannot_recycle_log_size=348938769, threshold=6957847019, need_update_checkpoint_scn=false) [2024-06-24 16:58:59.047134] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [163837][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=40] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47815fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:59.051209] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4093, avg_group_log_size=372) [2024-06-24 16:58:59.051242] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=4556) [2024-06-24 16:58:59.055431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-06-24 16:58:59.057248] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1394][T1004_HAService][T1004][Y0-0000000000000000-0-0] [lt=23] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2024-06-24 16:58:59.066924] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.071712] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB1A4-0-0] [lt=15][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:59.074631] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB1A6-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:59.079811] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a47470, extra_info="") [2024-06-24 16:58:59.079852] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d7a11210, extra_info="id:1") [2024-06-24 16:58:59.079894] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:59.080224] INFO [LIB] stat (utility.h:1165) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=344, this=0x7f46d2f934f0, extra_info="palf_id:1001") [2024-06-24 16:58:59.080226] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1199][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:59.080486] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SYS](tenant_id=1002, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 387.00) [2024-06-24 16:58:59.080512] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CONFIG](tenant_id=1002, ref_cnt=2, io_config={group_num_:0, memory_limit_:7516192768, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=25461728, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0]) [2024-06-24 16:58:59.080603] INFO [COMMON] print_io_status (ob_io_manager.cpp:1568) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SYS](tenant_id=1004, io_status=sys_group_name: SLOG_IO, mode: write, size: 4096.00, iops: 2.00, rt: 386.00) [2024-06-24 16:58:59.080618] INFO [COMMON] print_io_status (ob_io_manager.cpp:1584) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CONFIG](tenant_id=1004, ref_cnt=2, io_config={group_num_:0, memory_limit_:15461882266, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:4}, enable_io_tracer:false, group_configs:[other_groups:{deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, allocated_memory=27062304, free_request_count=50000, free_result_count=50000, callback_queues=[0, 0, 0, 0]) [2024-06-24 16:58:59.080657] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS SENDER](send_index=1, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080675] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SENDER](send_index=2, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080688] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=3, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080701] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=4, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=5, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080727] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=6, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080740] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=7, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080755] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS SENDER](send_index=8, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080768] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=9, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=10, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080794] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=11, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080807] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=12, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080817] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9] [IO STATUS SENDER](send_index=13, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080830] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=14, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080843] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=15, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.080856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:855) [162157][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SENDER](send_index=16, req_count=0, reservation_ts=9223372036854775807, group_limitation_ts=9223372036854775807, tenant_limitation_ts=9223372036854775807, proportion_ts=9223372036854775807) [2024-06-24 16:58:59.091162] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.096080] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162461][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096164] INFO eloop_run (eloop.c:140) [162213][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1719219539096163, bytes: 171188767, bw: 0.022323 MB/s, add_ts: 1007611, add_bytes: 23585 [2024-06-24 16:58:59.096411] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162477][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=11] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096495] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162480][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162458][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=13] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162463][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096644] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162469][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096688] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162457][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.096837] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162466][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=10] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097135] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162462][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097298] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162468][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097332] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162478][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097339] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162473][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097344] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162439][BatchIO][T0][Y0-0000000000000000-0-0] [lt=8] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097491] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162470][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097549] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162459][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=9] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097552] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162431][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097601] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162479][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097634] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162481][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097639] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162460][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097637] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162467][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097642] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162471][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162440][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097640] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162475][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097643] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162465][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097653] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162474][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=14] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097654] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162484][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=16] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162472][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=18] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162476][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162448][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162454][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097658] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162450][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097679] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162482][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097692] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [162464][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097709] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162447][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097814] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162451][BatchIO][T0][Y0-0000000000000000-0-0] [lt=10] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097893] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162433][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097947] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162442][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.097996] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162449][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098136] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162452][BatchIO][T0][Y0-0000000000000000-0-0] [lt=11] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098139] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162430][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098183] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162429][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098280] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162436][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098358] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162453][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098417] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162455][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098570] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162435][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162444][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098638] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162438][BatchIO][T0][Y0-0000000000000000-0-0] [lt=12] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162432][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098646] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162443][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098647] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162441][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162445][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098730] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162437][BatchIO][T0][Y0-0000000000000000-0-0] [lt=14] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.098738] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162434][BatchIO][T0][Y0-0000000000000000-0-0] [lt=16] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.099040] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [162446][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.099098] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [957][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=90000, evict_batch_count=0, elapse_time=0, size_used=1489, mem_used=4159488) [2024-06-24 16:58:59.099701] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [162486][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2024-06-24 16:58:59.100200] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=24] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16527, offset=3766945}, end_cursor:ObLogCursor{file_id=1, log_id=16528, offset=3767218}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9dc4050, len:1375, log_data_len:273, seq:16527, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:59.103425] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D912-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1719219539102491000, start_id=1719219539102491000, end_id=1719219539102491001) [2024-06-24 16:58:59.103505] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D912-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7765, avg_group_log_size=647) [2024-06-24 16:58:59.103531] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1215][T1004_TeRec][T1003][YB42AC141156-00061B9D9330D912-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=7765) [2024-06-24 16:58:59.103793] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [1460][T1003_IOWorker][T1003][Y0-0000000000000000-0-0] [lt=5] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=7765) [2024-06-24 16:58:59.103821] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=7765) [2024-06-24 16:58:59.103854] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1459][T1003_LogIOCb0][T1003][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=17, avg_log_submit_to_flush_time=311, avg_log_submit_to_slide_time=322) [2024-06-24 16:58:59.104440] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [1304][T1004_OB_SLOG][T1004][Y0-0000000000000000-0-0] [lt=26] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=1, log_id=16528, offset=3767218}, end_cursor:ObLogCursor{file_id=1, log_id=16529, offset=3767483}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f47e9dc8050, len:1102, log_data_len:265, seq:16528, flush_finish:false, flush_ret:0}) [2024-06-24 16:58:59.124484] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB1E1-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:59.135528] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1719219539135217000, start_id=1719219539135217000, end_id=1719219539135217001) [2024-06-24 16:58:59.135958] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [162984][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=16] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:59.161934] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1719219539161545000, start_id=1719219539161545000, end_id=1719219539161545001) [2024-06-24 16:58:59.166984] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.174062] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219539173087000, start_id=1719219539173087000, end_id=1719219539173087001) [2024-06-24 16:58:59.177144] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1636) [162308][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=27] skip inspect bad block(last_check_time=1719213246329660, last_macro_idx=-1) [2024-06-24 16:58:59.179891] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2024-06-24 16:58:59.179920] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:59.179959] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1220) [2024-06-24 16:58:59.180272] INFO [LIB] stat (utility.h:1182) [1200][T1004_IOWorker][T1004][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f471f2dec70, extra_info="") [2024-06-24 16:58:59.180286] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="172.20.17.86:2882", committed size=1342) [2024-06-24 16:58:59.180326] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f46d2f896a0, extra_info="palf_id:1001") [2024-06-24 16:58:59.180346] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=404, this=0x7f46d2f898d0, extra_info="palf_id:1001") [2024-06-24 16:58:59.180362] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="172.20.17.86:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=7, avg_log_submit_to_flush_time=376, avg_log_submit_to_slide_time=388) [2024-06-24 16:58:59.180387] INFO [LIB] stat (utility.h:1165) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f46d2f93720, extra_info="palf_id:1001") [2024-06-24 16:58:59.184734] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EF-0-0] [lt=13] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:59.184755] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [1218][T1004_BalanceEx][T1004][YB42AC141156-00061B9D9920D8EF-0-0] [lt=17] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:59.186012] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1090) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="172.20.17.86:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2024-06-24 16:58:59.186037] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, append size=1211) [2024-06-24 16:58:59.188580] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D90A-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2024-06-24 16:58:59.188608] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [163728][T1002_BalanceEx][T1002][YB42AC141156-00061B9D9280D90A-0-0] [lt=25] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2024-06-24 16:58:59.191220] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.192963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283419176960, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:59.199371] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219539198435000, start_id=1719219539198435000, end_id=1719219539198435001) [2024-06-24 16:58:59.202777] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [964][T1001_LSArchive][T1001][YB42AC141156-00061B9D8D80C0E5-0-0] [lt=21] gc stale ls task succ [2024-06-24 16:58:59.216249] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:636) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=19327296, clean_num=201326) [2024-06-24 16:58:59.221411] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219539220570000, start_id=1719219539220570000, end_id=1719219539220570001) [2024-06-24 16:58:59.251318] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f47b6889470, extra_info="") [2024-06-24 16:58:59.251351] INFO [LIB] stat (utility.h:1165) [162985][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f47b6859210, extra_info="id:1") [2024-06-24 16:58:59.251750] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=6, this=0x7f47b68896a0, extra_info="palf_id:1") [2024-06-24 16:58:59.251775] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=375, this=0x7f47b68898d0, extra_info="palf_id:1") [2024-06-24 16:58:59.251791] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=347, avg_log_submit_to_slide_time=361) [2024-06-24 16:58:59.251814] INFO [LIB] stat (utility.h:1165) [162830][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=29, this=0x7f47b6893720, extra_info="palf_id:1") [2024-06-24 16:58:59.255522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-06-24 16:58:59.267040] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.280777] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1755) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="172.20.17.86:2882", committed size=1220) [2024-06-24 16:58:59.280813] INFO [PALF] sliding_cb (log_sliding_window.cpp:2268) [1198][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="172.20.17.86:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=485, avg_log_submit_to_slide_time=494) [2024-06-24 16:58:59.284662] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB2E0-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4847, pos=2781, bitmap=NULL) [2024-06-24 16:58:59.287677] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043BFD-0-0] [lt=29][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4856, pos=2770, bitmap=NULL) [2024-06-24 16:58:59.291280] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.293847] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078DF5-0-0] [lt=27][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4607, pos=3045, bitmap=NULL) [2024-06-24 16:58:59.296961] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078DF6-0-0] [lt=35][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4850, pos=2778, bitmap=NULL) [2024-06-24 16:58:59.300078] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078DF7-0-0] [lt=30][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4845, pos=2781, bitmap=NULL) [2024-06-24 16:58:59.300981] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [947][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=37] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=170, total_destructed_detector=170, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f47647fa2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2024-06-24 16:58:59.302398] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:349) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2024-06-24 16:58:59.302429] INFO [PALF] get_disk_usage (palf_env_impl.cpp:892) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] get_disk_usage(ret=0, capacity(MB):=2457, used(MB):=131) [2024-06-24 16:58:59.302467] INFO [STORAGE] cannot_recycle_log_over_threshold_ (ob_checkpoint_service.cpp:261) [961][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=25] cannot_recycle_log_size statistics(cannot_recycle_log_size=70473348, threshold=773094113, need_update_checkpoint_scn=false) [2024-06-24 16:58:59.325204] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB325-0-0] [lt=25][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4858, pos=2770, bitmap=NULL) [2024-06-24 16:58:59.328472] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [162967][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=438086664, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=112722, mem_used=264127488) [2024-06-24 16:58:59.328616] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB327-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4838, pos=2788, bitmap=NULL) [2024-06-24 16:58:59.334039] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB32D-0-0] [lt=44][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4839, pos=2787, bitmap=NULL) [2024-06-24 16:58:59.334565] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078E1C-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219539333631000, start_id=1719219539333631000, end_id=1719219539333631001) [2024-06-24 16:58:59.335385] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [638][T1002_L0_G0][T1002][YB42AC141156-00061B9D9C043C2C-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219539334689000, start_id=1719219539334689000, end_id=1719219539334689001) [2024-06-24 16:58:59.335443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:4886) [1392][T1004_SSTableGC][T1004][YB42AC141156-00061B9D99A0C1B2-0-0] [lt=21] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_min_reserved_snapshot=1719217736809822000, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1719217726802034000) [2024-06-24 16:58:59.335670] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162968][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1719219539334689000, start_id=1719219539334689000, end_id=1719219539334689001) [2024-06-24 16:58:59.336727] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:133) [1230][T1004_Occam][T1004][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2024-06-24 16:58:59.337343] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=38][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=489, pos=78, bitmap=NULL) [2024-06-24 16:58:59.337471] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=28][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1374, pos=84, bitmap=NULL) [2024-06-24 16:58:59.337794] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1892, pos=85, bitmap=NULL) [2024-06-24 16:58:59.337886] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=22][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1701, pos=88, bitmap=NULL) [2024-06-24 16:58:59.338108] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=500, pos=79, bitmap=NULL) [2024-06-24 16:58:59.338218] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=18][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=5, len=2878, pos=2871, bitmap=NULL) [2024-06-24 16:58:59.338372] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB332-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=4, len=1674, pos=87, bitmap=NULL) [2024-06-24 16:58:59.345387] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [418][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2024-06-24 16:58:59.348933] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078E32-0-0] [lt=23][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4609, pos=3045, bitmap=NULL) [2024-06-24 16:58:59.362217] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1599][T1003_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1719219539361154000, start_id=1719219539361154000, end_id=1719219539361154001) [2024-06-24 16:58:59.367098] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.374060] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:263) [338][T1002_TenantWea][T1001][YB42AC141156-00061B9D903138AB-0-0] [lt=31] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.583041954040527344e+01, this=0x7f4764ff1208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=379, Throttle Trigger(MB)=227, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=8.484752065169477646e+02) [2024-06-24 16:58:59.374283] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [338][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1719219539373876000, start_id=1719219539373876000, end_id=1719219539373876001) [2024-06-24 16:58:59.378270] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:581) [162925][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3916EEE", sizeof(T):3952, used_obj_cnt:906, free_obj_hold_cnt:114, allocator used:4055520, allocator total:4186112}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:116, free_obj_hold_cnt:0, allocator used:7608556, allocator total:7608556}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():178560, full allocator used:1600, full allocator total:244096}, tablets_mem=12038764, tablets_mem_limit=3650722200, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:11, free_obj_hold_cnt:98, allocator used:223232, allocator total:261632}, pending_cnt=0, wait_gc_count=0, tablet count=1022) [2024-06-24 16:58:59.379499] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:124) [1392][T1004_SSTableGC][T1004][YB42AC141156-00061B9D99A0C1B2-0-0] [lt=39] SSTableGCTask(cost_ts=44900) [2024-06-24 16:58:59.380033] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46d2f89470, extra_info="") [2024-06-24 16:58:59.380060] INFO [LIB] stat (utility.h:1165) [1395][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f46caf89210, extra_info="id:1001") [2024-06-24 16:58:59.382647] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [162401][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1719219539382362000, start_id=1719219539382362000, end_id=1719219539382362001) [2024-06-24 16:58:59.382693] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2024-06-24 16:58:59.383121] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [162401][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1004, need_refresh=false, gts_local_cache={srr:[mts=1719219539383103], gts:1719219539382362000, latest_srr:[mts=1719219539383103]}) [2024-06-24 16:58:59.386123] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753cb3470, extra_info="") [2024-06-24 16:58:59.386154] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f4753c83210, extra_info="id:1") [2024-06-24 16:58:59.386505] INFO [LIB] stat (utility.h:1165) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=366, this=0x7f4753cbd4f0, extra_info="palf_id:1") [2024-06-24 16:58:59.386530] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2167) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, accum_size=1220) [2024-06-24 16:58:59.386561] INFO [LIB] stat (utility.h:1182) [163709][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f477d97c530, extra_info="") [2024-06-24 16:58:59.386571] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=7] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f4753cb36a0, extra_info="palf_id:1") [2024-06-24 16:58:59.386581] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=10] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=417, this=0x7f4753cb38d0, extra_info="palf_id:1") [2024-06-24 16:58:59.386586] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=4] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f4753cbd720, extra_info="palf_id:1") [2024-06-24 16:58:59.391337] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.391364] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB374-0-0] [lt=17][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4841, pos=2787, bitmap=NULL) [2024-06-24 16:58:59.394415] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [628][T1002_L0_G0][T1002][YB42AC141156-00061B9DA13AB376-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4848, pos=2778, bitmap=NULL) [2024-06-24 16:58:59.399532] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [1378][T1004_TenantWea][T1003][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219539399281000, start_id=1719219539399281000, end_id=1719219539399281001) [2024-06-24 16:58:59.405142] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:59.405182] INFO [COMMON] handle (memory_dump.cpp:552) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-06-24 16:58:59.405529] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [162171][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] update_check_range(min_check_version=624, max_check_version=625, global_version=626) [2024-06-24 16:58:59.416761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1134) [162172][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-283419176960, global_cache_size=382861312, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:8, 500, 508, 509, 1, 1001, 1002, 1003, 1004]) [2024-06-24 16:58:59.421493] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [958][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1719219539421490000, start_id=1719219539421490000, end_id=1719219539421490001) [2024-06-24 16:58:59.423189] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:222) [1377][T1004_ReqMemEvi][T1004][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1004, evict_high_mem_level=371085173, evict_high_size_level=9000000, evict_batch_count=0, elapse_time=0, size_used=130024, mem_used=326519808) [2024-06-24 16:58:59.445731] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2024-06-24 16:58:59.446311] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [633][T1002_L0_G0][T1002][YB42AC141156-00061B9DA1078EB8-0-0] [lt=26][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=21, len=4840, pos=2788, bitmap=NULL) [2024-06-24 16:58:59.447867] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1433) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] succ to get rec scn(*this={this:0x7f4753204030, ls_id:{id:1}, tenant_id:1001, state:"L_WORKING", total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:1719215114061534000, v:0}, last_push_gc_task_ts_:1719215125892860, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:916}, aggre_rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:59.447910] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] tx ctx memtable get rec scn(this={ObITable:{this:0x7f47553e6080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:1719215115892415, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f47553e6080, snapshot_version:{val:1719215115892415, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2024-06-24 16:58:59.447955] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:842) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2024-06-24 16:58:59.448101] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f475530e510, is_inited:true, freezing_scn:{val:1719215114061534000, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1719215115970533000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1719213329728427006, v:0}, all_id_meta:{id_meta:[{limited_id:1719219547830421000, latest_log_ts:{val:1719219531216126001, v:0}}, {limited_id:1000001, latest_log_ts:{val:1719213327932892004, v:0}}, {limited_id:30000001, latest_log_ts:{val:1719218717495258001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}}, switch_epoch:1, log_handler:{role:1, proposal_id:1, palf_env_:0x7f4760ea2030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2024-06-24 16:58:59.448230] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:600) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=123] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f475531f790}, min_rec_scn={val:1719215115970533000, v:0}, ls_id_={id:1}) [2024-06-24 16:58:59.448259] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:470) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2024-06-24 16:58:59.448282] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=0, rec_log_ts={val:1719219531216126001, v:0}) [2024-06-24 16:58:59.448296] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:4611686018427387903, v:0}) [2024-06-24 16:58:59.448310] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:307) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:1719218717495258001, v:0}) [2024-06-24 16:58:59.448329] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:187) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1719215115970533000, v:0}, checkpoint_scn_in_ls_meta={val:1719215115970533000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2024-06-24 16:58:59.448358] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1582) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"172.20.17.86:2882", has_set_deleted:false}, curr_base_lsn={lsn:0}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2024-06-24 16:58:59.448383] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:185) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2024-06-24 16:58:59.448400] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:192) [959][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2024-06-24 16:58:59.467156] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [1373][T1004_STSWorker][T1004][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.467943] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:693) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=83100000, replace_num=100000) [2024-06-24 16:58:59.467973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [162173][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-06-24 16:58:59.480518] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=21, this=0x7f46cae9c280, extra_info="") [2024-06-24 16:58:59.480545] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=25] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=408, this=0x7f46cae9c4b0, extra_info="") [2024-06-24 16:58:59.480559] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=0, this=0x7f46cae9c6e0, extra_info="") [2024-06-24 16:58:59.480573] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=-553, this=0x7f46cae9c910, extra_info="") [2024-06-24 16:58:59.480586] INFO [LIB] stat (utility.h:1165) [1313][T1004_ApplySrv0][T1004][YB42AC141156-00061B9D9E40C30F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=17, stat_interval=5000000, avg (count/cost)=-123, this=0x7f46cae9cb40, extra_info="") [2024-06-24 16:58:59.483374] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [1617][T1003_HAService][T1003][Y0-0000000000000000-0-0] [lt=27] start do ls ha handler(ls_id_array_=[{id:1}]) [2024-06-24 16:58:59.486214] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736731470, extra_info="") [2024-06-24 16:58:59.486247] INFO [LIB] stat (utility.h:1165) [423][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f4736705210, extra_info="id:1001") [2024-06-24 16:58:59.486566] INFO [LIB] stat (utility.h:1165) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=355, this=0x7f473673b4f0, extra_info="palf_id:1001") [2024-06-24 16:58:59.486592] INFO [LIB] stat (utility.h:1182) [163710][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=16, this=0x7f477d97cc70, extra_info="") [2024-06-24 16:58:59.486600] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=5] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=2, this=0x7f47367316a0, extra_info="palf_id:1001") [2024-06-24 16:58:59.486608] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=8] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=412, this=0x7f47367318d0, extra_info="palf_id:1001") [2024-06-24 16:58:59.486613] INFO [LIB] stat (utility.h:1165) [163708][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=4] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=9, this=0x7f473673b720, extra_info="palf_id:1001") [2024-06-24 16:58:59.491395] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [328][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2024-06-24 16:58:59.504426] WDIAG alloc_block (ob_block_alloc_mgr.h:40) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8BB-0-0] [lt=44][errcode=-4013] block alloc over limit, limit=51539607 alloc_size=2079744 [2024-06-24 16:58:59.504448] WDIAG [SERVER] record_request (ob_mysql_request_manager.cpp:177) [1217][T1004_PLSSer][T1003][YB42AC141156-00061B9D9910D8BB-0-0] [lt=21][errcode=0] record concurrent fifoallocator alloc mem failed(total_size=1726, tenant_id_=1003, mem_limit_=171798691, request_id_=0, ret=0)