[2024-06-25 18:17:13.272526] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=12] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:13.272544] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=18] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:13.272548] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:13.272554] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=4] start distribute for server status change
[2024-06-25 18:17:13.272599] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=3] finish distribute for server status change(ret=0)
[2024-06-25 18:17:13.272609] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=9] finish do unit balance(ret=0)
[2024-06-25 18:17:13.275929] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:13.275945] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=16] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:13.275949] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:13.275958] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=4] start to do tenant group unit balance
[2024-06-25 18:17:13.275976] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=3] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:13.276002] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=20] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:13.276019] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=12] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:13.525158] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFEF-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3068)
[2024-06-25 18:17:13.526353] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFEF-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:13.526374] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFEF-0-0] [lt=20][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:13.526402] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFEF-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:13.526411] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFEF-0-0] [lt=9][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:13.526418] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFEF-0-0] [lt=6][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:13.646173] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BF7-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:13.659238] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFEF-0-0] [lt=19] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:13.672513] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFEE-0-0] [lt=45] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:13.777766] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B49F-0-0] [lt=46] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:13.894296] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BE7-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:14.065008] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320BFB-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:14.077030] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C47-0-0] [lt=19] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310634016847000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310634074395000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310634074395000, v:0}}])
[2024-06-25 18:17:14.247001] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A53D-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:14.261972] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20BFA-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:14.428448] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310634030510, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310631650305003, v:0}, replayable_scn:{val:1719310631650305003, v:0}, standby_scn:{val:1719310631650305002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:14.510877] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:14.628394] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF0-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:14.646254] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BF8-0-0] [lt=10] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:14.895146] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BE8-0-0] [lt=28] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:15.065096] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320BFC-0-0] [lt=19] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:15.082647] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C48-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310634892265001, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310634892265001, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310634892265001, v:0}}])
[2024-06-25 18:17:15.167391] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:15.168748] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310635167303, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:15.168768] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310640168766, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:15.170034] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:15.171234] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310635169947, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:15.171251] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310640171250, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:15.262070] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20BFB-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:15.526489] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF0-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3069)
[2024-06-25 18:17:15.527634] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF0-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:15.527650] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF0-0-0] [lt=16][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:15.527677] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF0-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:15.527686] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF0-0-0] [lt=9][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:15.527692] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF0-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:15.646350] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BF9-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:15.661461] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF0-0-0] [lt=17] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:15.672894] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFEF-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:15.778198] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A0-0-0] [lt=22] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:15.896032] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BE9-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:16.032387] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310634070138001, v:0}, replayable_scn:{val:1719310634070138001, v:0}, standby_scn:{val:1719310634070138001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310636029879, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310634070138001, v:0}, replayable_scn:{val:1719310634070138001, v:0}, standby_scn:{val:1719310634070138001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310636029879, ora_rowscn_=1719310635084125001)
[2024-06-25 18:17:16.065180] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320BFD-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:16.089114] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C49-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310635811832002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310635811832002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310635811832002, v:0}}])
[2024-06-25 18:17:16.247398] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A53E-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:16.262161] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20BFC-0-0] [lt=25] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:16.449317] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D012159A-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:16.628803] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF1-0-0] [lt=10] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:16.646435] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BFA-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:16.896879] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BEA-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:17.065265] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320BFE-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:17.095039] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4A-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310636813482002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310636813482002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310636813482002, v:0}}])
[2024-06-25 18:17:17.262249] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20BFD-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:17.430445] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310637030917, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310634892265001, v:0}, replayable_scn:{val:1719310634892265001, v:0}, standby_scn:{val:1719310634892265001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:17.527763] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF1-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3070)
[2024-06-25 18:17:17.528765] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF1-0-0] [lt=12][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:17.528780] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF1-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:17.528810] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF1-0-0] [lt=12][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:17.528823] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF1-0-0] [lt=13][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:17.528828] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF1-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:17.599582] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:17.646521] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BFB-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:17.664126] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF1-0-0] [lt=18] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:17.673425] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF0-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:17.778665] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A1-0-0] [lt=10] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:17.897725] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BEB-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:18.039328] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=5] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:18.039350] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310643039344, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:18.065348] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320BFF-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:18.100802] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4B-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310637813558002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310637813558002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310637813558002, v:0}}])
[2024-06-25 18:17:18.247817] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A53F-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:18.262333] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20BFE-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:18.629228] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF2-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:18.646603] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BFC-0-0] [lt=11] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:18.898625] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BEC-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:19.032633] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310636656208004, v:0}, replayable_scn:{val:1719310636656208004, v:0}, standby_scn:{val:1719310636656208004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310639030099, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310636656208004, v:0}, replayable_scn:{val:1719310636656208004, v:0}, standby_scn:{val:1719310636656208004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310639030099, ora_rowscn_=1719310638101932000)
[2024-06-25 18:17:19.065433] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C00-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:19.106674] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4C-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310638814764002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310638814764002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310638814764002, v:0}}])
[2024-06-25 18:17:19.182829] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFDF-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:19.262412] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20BFF-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:19.528870] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF2-0-0] [lt=6] start do ObArchiveSchedulerService round(round=3071)
[2024-06-25 18:17:19.529881] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF2-0-0] [lt=16][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:19.529895] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF2-0-0] [lt=13][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:19.529919] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF2-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:19.529930] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF2-0-0] [lt=11][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:19.529936] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF2-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:19.646682] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BFD-0-0] [lt=11] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:19.666379] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF2-0-0] [lt=15] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:19.673957] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF1-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL)
[2024-06-25 18:17:19.779162] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A2-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:19.799667] INFO  [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2244) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65A-0-0] [lt=14] need check schema(new_schema_version=1719298380350128, cached_tenant_schema_version=1719298380350128, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT column_value FROM __all_core_table WHERE TABLE_NAME = ? AND COLUMN_NAME = ? FOR UPDATE)
[2024-06-25 18:17:19.799959] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65A-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719310639798927000, start_id=1719310639798927000, end_id=1719310639798927001)
[2024-06-25 18:17:19.800856] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65A-0-0] [lt=14] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310639798927000, v:0}, tenant_id=1)
[2024-06-25 18:17:19.802219] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B284-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:19.899535] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BED-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:20.059344] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:17:20.059365] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=17] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:17:20.059371] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=5] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:20.065549] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C01-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:20.085252] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=3] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:17:20.085269] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=15] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:17:20.085275] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=6] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:20.112927] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4D-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310639816213002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310639816213002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310639816213002, v:0}}])
[2024-06-25 18:17:20.168860] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:20.170773] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310640168766, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:20.170804] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=29] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310645170802, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:20.171419] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=8] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:20.174212] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=28] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310640171250, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:20.174260] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=44] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310645174256, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:20.248295] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A540-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:20.262494] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C00-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:20.432458] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310640030832, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310637657083004, v:0}, replayable_scn:{val:1719310637657083004, v:0}, standby_scn:{val:1719310637657083004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:20.504793] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.505438] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.506864] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.539838] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.565166] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.567209] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=43] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.580837] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=40] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.629687] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF3-0-0] [lt=12] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:20.646749] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BFE-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:20.826956] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=39] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.827561] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] failed to get result(ret=-4008)
[2024-06-25 18:17:20.827613] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403704194, start_date_:1718373600000000, last_date_:1718978400000779, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:7054546, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603738087, start_date_:1718632800000000, last_date_:1719237600000767, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:7182242, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306137823202, start_date_:1718269337418154, last_date_:1719306137418936, this_date_:0, next_date_:1719392537418154, end_date_:64060560000000000, total_:2642272, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007201952035, start_date_:1718402400000000, last_date_:1719007200000866, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:4741093, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603749582, start_date_:1718488800000000, last_date_:1719093600000690, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:7242320, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892004284235, start_date_:1718287200000000, last_date_:1718892000000847, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:8227853, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719202175465, start_date_:1718719200000000, last_date_:1718719200000726, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:2174739, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805604724120, start_date_:1718200800000000, last_date_:1718805600000742, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:37147500, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:17:20.828964] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=43] failed to get result(ret=-4008)
[2024-06-25 18:17:20.829003] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403130376, start_date_:1718373600000000, last_date_:1718978400003681, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:6132367, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237601947143, start_date_:1718632800000000, last_date_:1719237600003445, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:5102524, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306194546834, start_date_:1718269394113443, last_date_:1719306194115039, this_date_:0, next_date_:1719392594113443, end_date_:64060560000000000, total_:3284449, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007200659206, start_date_:1718402400000000, last_date_:1719007200007246, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:2269654, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603091085, start_date_:1718488800000000, last_date_:1719093600003492, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:5856845, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892003073665, start_date_:1718287200000000, last_date_:1718892000003898, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:5290345, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719203797237, start_date_:1718719200000000, last_date_:1718719200004208, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:3793029, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805602049343, start_date_:1718200800000000, last_date_:1718805600003825, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:13517012, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:17:20.831432] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=40] failed to get result(ret=-4008)
[2024-06-25 18:17:20.831465] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403755745, start_date_:1718373600000000, last_date_:1718978400009636, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:9178981, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603214741, start_date_:1718632800000000, last_date_:1719237600008773, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:8157181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306206300927, start_date_:1718269406072562, last_date_:1719306206074204, this_date_:0, next_date_:1719392606072562, end_date_:64060560000000000, total_:2552147, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007204300685, start_date_:1718402400000000, last_date_:1719007200014486, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:7423181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093604691429, start_date_:1718488800000000, last_date_:1719093600010541, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:9650110, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892005643742, start_date_:1718287200000000, last_date_:1718892000009893, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:13725944, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719207006246, start_date_:1718719200000000, last_date_:1718719200016920, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:6989326, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805605317652, start_date_:1718200800000000, last_date_:1718805600009364, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:23735393, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:17:20.831502] INFO  [RS] check_all_tenants (ob_dbms_sched_job_master.cpp:631) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=36] check all tenants(ret=0)
[2024-06-25 18:17:20.836086] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=4] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.838678] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.865619] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.867007] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.868252] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.872255] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.883309] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.886819] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.889475] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.893026] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.898166] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.900511] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BEE-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:20.902241] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:20.907676] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:21.065652] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C02-0-0] [lt=36] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:21.118527] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4E-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310640817261002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310640817261002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310640817261002, v:0}}])
[2024-06-25 18:17:21.262581] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C01-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:21.301583] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=16] start checking lost replicas
[2024-06-25 18:17:21.530011] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF3-0-0] [lt=6] start do ObArchiveSchedulerService round(round=3072)
[2024-06-25 18:17:21.531220] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF3-0-0] [lt=16][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:21.531235] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF3-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:21.531263] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF3-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:21.531276] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF3-0-0] [lt=13][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:21.531282] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF3-0-0] [lt=6][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:21.646841] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320BFF-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:21.668692] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF3-0-0] [lt=17] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:21.674351] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF2-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:21.779676] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A3-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:21.901319] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BEF-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:22.032905] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310639816213002, v:0}, replayable_scn:{val:1719310639816213002, v:0}, standby_scn:{val:1719310639816213002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310642030430, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310639816213002, v:0}, replayable_scn:{val:1719310639816213002, v:0}, standby_scn:{val:1719310639816213002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310642030430, ora_rowscn_=1719310641120001000)
[2024-06-25 18:17:22.065741] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C03-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:22.124652] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4F-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310641817847002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310641817847002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310641817847002, v:0}}])
[2024-06-25 18:17:22.128896] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C4F-0-0] [lt=11] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310639816213002, v:0})
[2024-06-25 18:17:22.191649] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B285-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:22.192876] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B286-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:22.193196] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B289-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:17:22.193515] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B28A-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:22.193807] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B28B-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:22.194058] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B28C-0-0] [lt=10] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:17:22.194316] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B28D-0-0] [lt=5] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:22.194641] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B28E-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:22.248728] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A541-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:22.262663] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C02-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:22.630047] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF4-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:22.646922] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C00-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:22.902303] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF0-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:23.039435] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=27] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:23.039455] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310648039450, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:23.065860] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C04-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:23.130570] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C50-0-0] [lt=14] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310642819423002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310642819423002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310642819423002, v:0}}])
[2024-06-25 18:17:23.134316] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C50-0-0] [lt=9] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310642819423002, v:0}, readable_scn:{val:1719310642819423002, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})
[2024-06-25 18:17:23.262817] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C03-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:23.276683] INFO  [RS.LB] idle (ob_root_balancer.cpp:103) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420703-0-0] [lt=10] root balance idle(idle_time=10000000)
[2024-06-25 18:17:23.276710] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1936) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=14] start try disaster recovery
[2024-06-25 18:17:23.276716] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] start try tenant disaster recovery(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:23.277469] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] start try ls disaster recovery(ls_status_info={tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:23.280272] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=18] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:23.280295] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=20] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.280300] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1, ls_id:{id:1}, replicas:[{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:23.280374] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=71] build ls locality stat map(tenant_id=1, ls_id={id:1})
[2024-06-25 18:17:23.280380] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.280386] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=6] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.280389] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.280393] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:23.280440] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=41] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.280447] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.280450] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=2] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.280453] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.281374] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:23.281385] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=11] start try tenant disaster recovery(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:23.281866] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:23.284408] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=15] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1001, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:23.284426] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.284431] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1001, ls_id:{id:1}, replicas:[{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:23.284497] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=63] build ls locality stat map(tenant_id=1001, ls_id={id:1})
[2024-06-25 18:17:23.284502] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.284507] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.284510] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.284515] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:23.284563] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.284570] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.284577] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.284580] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.285398] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] try tenant disaster recovery succ(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:23.286722] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=14] start try tenant disaster recovery(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:23.288046] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=12] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:23.291231] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=17] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:23.291250] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=16] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.291255] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1}, replicas:[{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:23.291321] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=64] build ls locality stat map(tenant_id=1002, ls_id={id:1})
[2024-06-25 18:17:23.291326] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.291332] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.291338] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.291342] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:23.291390] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.291397] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.291400] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=2] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.291405] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.292190] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:23.297897] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=11] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1001}, acc_dr_task=0)
[2024-06-25 18:17:23.297915] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=16] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.297919] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1001}, replicas:[{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:23.297983] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=63] build ls locality stat map(tenant_id=1002, ls_id={id:1001})
[2024-06-25 18:17:23.297989] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.297995] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=6] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.297999] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.298002] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:23.298049] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.298055] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.298061] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.298064] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.298845] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:23.304500] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1002}, acc_dr_task=0)
[2024-06-25 18:17:23.304519] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=16] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.304524] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1002}, replicas:[{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:23.304589] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=64] build ls locality stat map(tenant_id=1002, ls_id={id:1002})
[2024-06-25 18:17:23.304595] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.304599] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.304602] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.304607] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:23.304655] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.304662] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.304668] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.304671] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.305449] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=6] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:23.311207] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1003}, acc_dr_task=0)
[2024-06-25 18:17:23.311225] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.311230] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1003}, replicas:[{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:23.311295] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=63] build ls locality stat map(tenant_id=1002, ls_id={id:1003})
[2024-06-25 18:17:23.311300] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.311304] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.311308] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:23.311312] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:23.311359] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.311365] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.311372] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.311375] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:23.312130] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:23.312155] INFO  [RS] check (ob_migrate_unit_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=22] start check unit migrate finish
[2024-06-25 18:17:23.312162] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=4] try check migrate unit finish by tenant(tenant_id=1)
[2024-06-25 18:17:23.314871] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=7] try check migrate unit finish by tenant(tenant_id=1002)
[2024-06-25 18:17:23.327448] INFO  [RS] check (ob_alter_locality_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420704-0-0] [lt=13] start to check alter locality finish
[2024-06-25 18:17:23.327897] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420705-0-0] [lt=14][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.328320] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420705-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.329227] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420707-0-0] [lt=11][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.329662] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420707-0-0] [lt=9][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.330121] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:72) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420707-0-0] [lt=11] start check shrink resource pool
[2024-06-25 18:17:23.330135] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420708-0-0] [lt=11] start check shrink resource pool(tenant_id=1)
[2024-06-25 18:17:23.330535] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420708-0-0] [lt=3][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.330968] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420708-0-0] [lt=10][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.330998] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420709-0-0] [lt=11] start check shrink resource pool(tenant_id=1002)
[2024-06-25 18:17:23.331420] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420709-0-0] [lt=7][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.331865] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420709-0-0] [lt=9][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.331902] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:100) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420709-0-0] [lt=18] finish check shrink resource pool(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:23.331911] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:49) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420709-0-0] [lt=9] start check primary zone
[2024-06-25 18:17:23.331917] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070A-0-0] [lt=4] start check primary zone(tenant_id=1)
[2024-06-25 18:17:23.332325] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070A-0-0] [lt=3][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.332352] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=9] start check primary zone(tenant_id=1002)
[2024-06-25 18:17:23.332752] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=6][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:23.332780] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:179) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=10] start do unit balance
[2024-06-25 18:17:23.333199] INFO  [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [43229][RootBalance][T1][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1719310643333190})
[2024-06-25 18:17:23.333321] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D012159B-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:23.337937] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=12] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:23.337956] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=19] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:23.337960] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:23.337965] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=2] start distribute for server status change
[2024-06-25 18:17:23.338006] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=3] finish distribute for server status change(ret=0)
[2024-06-25 18:17:23.338014] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=7] finish do unit balance(ret=0)
[2024-06-25 18:17:23.342582] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=2] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:23.342596] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=14] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:23.342599] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:23.342606] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=3] start to do tenant group unit balance
[2024-06-25 18:17:23.342622] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=3] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:23.342644] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=17] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:23.342659] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=10] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:23.434373] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310643030581, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310640660082004, v:0}, replayable_scn:{val:1719310640660082004, v:0}, standby_scn:{val:1719310640660082004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:23.531540] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF4-0-0] [lt=8] start do ObArchiveSchedulerService round(round=3073)
[2024-06-25 18:17:23.532847] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF4-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:23.532862] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF4-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:23.532898] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF4-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:23.532913] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF4-0-0] [lt=15][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:23.532919] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF4-0-0] [lt=6][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:23.647012] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C01-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:23.670953] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF4-0-0] [lt=19] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:23.674729] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF3-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:23.780194] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A4-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL)
[2024-06-25 18:17:23.903293] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF1-0-0] [lt=22] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:24.031080] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D012159C-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:24.032652] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215A0-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:24.032929] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43660][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215A1-0-0] [lt=6] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:24.033124] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215A2-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:24.033544] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43663][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215A8-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:24.033860] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215A9-0-0] [lt=4] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:24.066025] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C05-0-0] [lt=44] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:24.136629] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C51-0-0] [lt=18] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310643819716003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310643819716003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310643819716003, v:0}}])
[2024-06-25 18:17:24.249118] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A542-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:24.262969] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C04-0-0] [lt=46] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:24.630441] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF5-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:24.647095] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C02-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:24.904175] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF2-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:25.033010] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310642661045004, v:0}, replayable_scn:{val:1719310642661045004, v:0}, standby_scn:{val:1719310642661045004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310645030940, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310642661045004, v:0}, replayable_scn:{val:1719310642661045004, v:0}, standby_scn:{val:1719310642661045004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310645030940, ora_rowscn_=1719310644136540001)
[2024-06-25 18:17:25.066107] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C06-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:25.142400] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C52-0-0] [lt=9] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310644821072003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310644821072003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310644821072003, v:0}}])
[2024-06-25 18:17:25.170885] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:25.173451] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310645170802, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:25.173471] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310650173469, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:25.174334] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=5] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:25.176838] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310645174256, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:25.176857] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310650176856, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:25.263078] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C05-0-0] [lt=45] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:25.449423] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215AB-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:25.533008] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF5-0-0] [lt=9] start do ObArchiveSchedulerService round(round=3074)
[2024-06-25 18:17:25.534052] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF5-0-0] [lt=17][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:25.534065] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF5-0-0] [lt=13][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:25.534089] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF5-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:25.534099] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF5-0-0] [lt=10][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:25.534104] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF5-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:25.647180] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C03-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:25.673613] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF5-0-0] [lt=17] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:25.675101] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF4-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:17:25.780657] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A5-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:25.831856] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE0-0-0] [lt=36] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:25.833190] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE4-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:25.833545] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE5-0-0] [lt=23] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:25.833813] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE6-0-0] [lt=9] [DDL] execute ddl like stmt(ret=0, cost=1, ddl_arg=NULL)
[2024-06-25 18:17:25.834195] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE7-0-0] [lt=10] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:25.834473] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE8-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:25.834717] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFE9-0-0] [lt=27] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:25.835032] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFEA-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:25.905066] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF3-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:26.066188] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C07-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:26.148584] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C53-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310645823537003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310645823537003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310645823537003, v:0}}])
[2024-06-25 18:17:26.249523] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A543-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:26.263159] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C06-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:26.436286] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310646030895, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310643819716003, v:0}, replayable_scn:{val:1719310643819716003, v:0}, standby_scn:{val:1719310643819716003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:26.510009] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:26.630847] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF6-0-0] [lt=15] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:26.647264] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C04-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:26.907697] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF4-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:27.066274] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C08-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:27.156858] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C54-0-0] [lt=9] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310646824060003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310646824060003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310646824060003, v:0}}])
[2024-06-25 18:17:27.203494] INFO  [SHARE] get_jobs (ob_backup_data_table_operator.cpp:714) [43481][T1_BackupDataSr][T1][YB420A0A0A33-00061BB2CA91F4C2-0-0] [lt=25] [DATA_BACKUP]success get jobs(job_attrs=[])
[2024-06-25 18:17:27.263275] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C07-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:27.534201] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF6-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3075)
[2024-06-25 18:17:27.535216] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF6-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:27.535230] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF6-0-0] [lt=13][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:27.535258] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF6-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:27.535269] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF6-0-0] [lt=11][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:27.535274] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF6-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:27.647346] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C05-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:27.675488] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF5-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:27.676288] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF6-0-0] [lt=18] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:27.781122] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A6-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:27.908614] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF5-0-0] [lt=68] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:27.920129] INFO  [RS] remove_inactive_ddl_task (ob_ddl_scheduler.cpp:2112) [44237][HeartBeatCheckT][T0][Y0-0000000000000000-0-0] [lt=5] need remove task(remove_task_ids=[])
[2024-06-25 18:17:27.920144] INFO  [RS] remove_inactive_ddl_task (ob_ddl_scheduler.cpp:2131) [44237][HeartBeatCheckT][T0][Y0-0000000000000000-0-0] [lt=14] remove all timeout ddl task succeed
[2024-06-25 18:17:28.033224] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310645666514004, v:0}, replayable_scn:{val:1719310645666514004, v:0}, standby_scn:{val:1719310645666514004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310648031020, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310645666514004, v:0}, replayable_scn:{val:1719310645666514004, v:0}, standby_scn:{val:1719310645666514004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310648031020, ora_rowscn_=1719310647161787000)
[2024-06-25 18:17:28.039542] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:28.039560] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310653039556, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:28.066360] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C09-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:28.163750] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C55-0-0] [lt=10] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310647825202004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310647825202004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310647825202004, v:0}}])
[2024-06-25 18:17:28.183073] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFEC-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:28.249916] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A544-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:17:28.263390] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C08-0-0] [lt=47] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:28.631392] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF7-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:28.647430] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C06-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:28.802713] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B290-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:28.909579] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF6-0-0] [lt=20] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:29.066477] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C0A-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:29.169818] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C56-0-0] [lt=10] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310648825913003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310648825913003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310648825913003, v:0}}])
[2024-06-25 18:17:29.263473] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C09-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:29.438280] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310649030746, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310646667624004, v:0}, replayable_scn:{val:1719310646667624004, v:0}, standby_scn:{val:1719310646667624004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:29.535343] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF7-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3076)
[2024-06-25 18:17:29.536352] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF7-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:29.536365] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF7-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:29.536389] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF7-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:29.536407] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF7-0-0] [lt=18][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:29.536412] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF7-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:29.647513] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C07-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:29.675881] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF6-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL)
[2024-06-25 18:17:29.678835] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF7-0-0] [lt=20] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:29.781600] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A7-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL)
[2024-06-25 18:17:29.803231] INFO  [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2244) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65B-0-0] [lt=15] need check schema(new_schema_version=1719298380350128, cached_tenant_schema_version=1719298380350128, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT column_value FROM __all_core_table WHERE TABLE_NAME = ? AND COLUMN_NAME = ? FOR UPDATE)
[2024-06-25 18:17:29.803519] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65B-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1719310649802602000, start_id=1719310649802602000, end_id=1719310649802602001)
[2024-06-25 18:17:29.804582] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65B-0-0] [lt=15] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310649802602000, v:0}, tenant_id=1)
[2024-06-25 18:17:29.910570] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF7-0-0] [lt=32] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:30.060576] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:17:30.060597] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=18] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:17:30.060603] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=5] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:30.066645] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C0B-0-0] [lt=99] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:30.086551] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:17:30.086573] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=18] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:17:30.086579] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=5] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:30.173554] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:30.174845] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310650173469, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:30.174864] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=17] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310655174862, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:30.176961] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=5] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:30.178053] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C57-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310649828386003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310649828386003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310649828386003, v:0}}])
[2024-06-25 18:17:30.179828] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=42] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310650176856, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:30.179841] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310655179840, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:30.250320] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A545-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:30.263557] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C0A-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:30.631872] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF8-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:30.647591] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C08-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:30.911340] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF8-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:31.033407] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310648988781001, v:0}, replayable_scn:{val:1719310648988781001, v:0}, standby_scn:{val:1719310648988781001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310651031702, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310648988781001, v:0}, replayable_scn:{val:1719310648988781001, v:0}, standby_scn:{val:1719310648988781001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310651031702, ora_rowscn_=1719310650183069000)
[2024-06-25 18:17:31.066727] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C0C-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:31.184936] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C58-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310650829158003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310650829158003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310650829158003, v:0}}])
[2024-06-25 18:17:31.263646] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C0B-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:31.304034] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=13] start checking lost replicas
[2024-06-25 18:17:31.536482] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF8-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3077)
[2024-06-25 18:17:31.537499] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF8-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:31.537511] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF8-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:31.537535] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF8-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:31.537547] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF8-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:31.537552] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF8-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:31.647675] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C09-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:31.676263] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF7-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:31.681422] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF8-0-0] [lt=22] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:31.782095] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A8-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:31.912306] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BF9-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:32.066809] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C0D-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:32.191301] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C59-0-0] [lt=18] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310651829958003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310651829958003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310651829958003, v:0}}])
[2024-06-25 18:17:32.196535] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C59-0-0] [lt=56] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310649892004002, v:0})
[2024-06-25 18:17:32.250810] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A546-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=30, ddl_arg=NULL)
[2024-06-25 18:17:32.263726] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C0C-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:32.396168] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B291-0-0] [lt=49] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:32.413248] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B292-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:32.413996] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215AC-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:32.440266] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310652031158, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310649892004002, v:0}, replayable_scn:{val:1719310649892004002, v:0}, standby_scn:{val:1719310649892004002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:32.632326] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFF9-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:32.647755] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C0A-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:32.915000] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BFA-0-0] [lt=21] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:33.039600] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:33.039617] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310658039612, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:33.066892] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C0E-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:33.198299] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5A-0-0] [lt=17] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310652831105003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310652831105003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310652831105003, v:0}}])
[2024-06-25 18:17:33.205372] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5A-0-0] [lt=13] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310652831105003, v:0}, readable_scn:{val:1719310652831105003, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})
[2024-06-25 18:17:33.263807] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C0D-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:33.342336] INFO  [RS.LB] idle (ob_root_balancer.cpp:103) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070B-0-0] [lt=6] root balance idle(idle_time=10000000)
[2024-06-25 18:17:33.342357] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1936) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=13] start try disaster recovery
[2024-06-25 18:17:33.342362] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] start try tenant disaster recovery(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:33.342978] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=5] start try ls disaster recovery(ls_status_info={tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:33.345745] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=16] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:33.345773] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=25] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.345778] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1, ls_id:{id:1}, replicas:[{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:33.345856] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=75] build ls locality stat map(tenant_id=1, ls_id={id:1})
[2024-06-25 18:17:33.345863] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.345870] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=7] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.345874] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.345878] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:33.345927] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.345935] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.345939] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.345943] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.346819] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=5] try tenant disaster recovery succ(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:33.346828] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=9] start try tenant disaster recovery(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:33.347325] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:33.349762] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=14] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1001, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:33.349779] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.349792] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=12] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1001, ls_id:{id:1}, replicas:[{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:33.349856] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=63] build ls locality stat map(tenant_id=1001, ls_id={id:1})
[2024-06-25 18:17:33.349862] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.349867] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.349872] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.349875] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:33.349924] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.349930] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.349935] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.349939] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.350750] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:33.352057] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=8] start try tenant disaster recovery(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:33.353240] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=13] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:33.356299] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=12] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:33.356318] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.356323] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1}, replicas:[{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:33.356391] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=66] build ls locality stat map(tenant_id=1002, ls_id={id:1})
[2024-06-25 18:17:33.356397] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.356402] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.356404] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.356407] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:33.356455] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.356462] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.356465] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.356468] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.357253] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=5] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:33.362919] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=11] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1001}, acc_dr_task=0)
[2024-06-25 18:17:33.362937] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.362942] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1001}, replicas:[{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:33.363006] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=63] build ls locality stat map(tenant_id=1002, ls_id={id:1001})
[2024-06-25 18:17:33.363012] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.363016] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.363019] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.363022] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:33.363068] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=42] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.363074] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.363078] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.363081] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.363851] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:33.369486] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1002}, acc_dr_task=0)
[2024-06-25 18:17:33.369508] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=19] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.369512] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1002}, replicas:[{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:33.369578] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=65] build ls locality stat map(tenant_id=1002, ls_id={id:1002})
[2024-06-25 18:17:33.369583] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.369587] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.369592] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.369595] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:33.369641] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=42] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.369647] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.369653] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.369656] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.370404] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:33.376107] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1003}, acc_dr_task=0)
[2024-06-25 18:17:33.376125] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.376130] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1003}, replicas:[{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:33.376192] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=61] build ls locality stat map(tenant_id=1002, ls_id={id:1003})
[2024-06-25 18:17:33.376197] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.376201] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.376204] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:33.376208] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:33.376254] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=42] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.376259] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=2] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.376262] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.376265] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:33.376981] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:33.376993] INFO  [RS] check (ob_migrate_unit_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=10] start check unit migrate finish
[2024-06-25 18:17:33.377000] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] try check migrate unit finish by tenant(tenant_id=1)
[2024-06-25 18:17:33.379721] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=3] try check migrate unit finish by tenant(tenant_id=1002)
[2024-06-25 18:17:33.392441] INFO  [RS] check (ob_alter_locality_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070C-0-0] [lt=13] start to check alter locality finish
[2024-06-25 18:17:33.392893] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070D-0-0] [lt=15][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.393348] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070D-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.394237] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070F-0-0] [lt=11][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.394670] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070F-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.395148] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:72) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42070F-0-0] [lt=11] start check shrink resource pool
[2024-06-25 18:17:33.395162] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420710-0-0] [lt=11] start check shrink resource pool(tenant_id=1)
[2024-06-25 18:17:33.395575] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420710-0-0] [lt=4][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.396003] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420710-0-0] [lt=10][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.396031] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420711-0-0] [lt=9] start check shrink resource pool(tenant_id=1002)
[2024-06-25 18:17:33.396452] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420711-0-0] [lt=6][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.396884] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420711-0-0] [lt=9][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.396912] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:100) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420711-0-0] [lt=9] finish check shrink resource pool(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:33.396920] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:49) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420711-0-0] [lt=7] start check primary zone
[2024-06-25 18:17:33.396925] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420712-0-0] [lt=3] start check primary zone(tenant_id=1)
[2024-06-25 18:17:33.397320] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420712-0-0] [lt=2][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.397346] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=8] start check primary zone(tenant_id=1002)
[2024-06-25 18:17:33.397736] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=4][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:33.397764] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:179) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=11] start do unit balance
[2024-06-25 18:17:33.398169] INFO  [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [43229][RootBalance][T1][YB420A0A0A33-00061BB2CC420713-0-0] [lt=5] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1719310653398159})
[2024-06-25 18:17:33.398313] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215AD-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:33.401244] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=11] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:33.401259] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=15] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:33.401263] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:33.401267] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=2] start distribute for server status change
[2024-06-25 18:17:33.401307] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=4] finish distribute for server status change(ret=0)
[2024-06-25 18:17:33.401314] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=7] finish do unit balance(ret=0)
[2024-06-25 18:17:33.404471] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:33.404486] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=15] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:33.404490] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:33.404496] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=2] start to do tenant group unit balance
[2024-06-25 18:17:33.404512] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=3] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:33.404535] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=18] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:33.404553] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=14] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:33.537605] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF9-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3078)
[2024-06-25 18:17:33.538592] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF9-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:33.538606] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF9-0-0] [lt=13][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:33.538629] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF9-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:33.538641] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF9-0-0] [lt=11][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:33.538645] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFF9-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:33.647837] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C0B-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:33.676652] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF8-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:17:33.689694] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFF9-0-0] [lt=52] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:33.782542] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4A9-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL)
[2024-06-25 18:17:33.915817] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BFB-0-0] [lt=68] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:34.035167] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310651673714005, v:0}, replayable_scn:{val:1719310651673714005, v:0}, standby_scn:{val:1719310651673714005, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310654031413, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310651673714005, v:0}, replayable_scn:{val:1719310651673714005, v:0}, standby_scn:{val:1719310651673714005, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310654031413, ora_rowscn_=1719310653203794001)
[2024-06-25 18:17:34.066994] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C0F-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:34.207693] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5B-0-0] [lt=17] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310653832907003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310653832907003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310653832907003, v:0}}])
[2024-06-25 18:17:34.251248] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A547-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL)
[2024-06-25 18:17:34.263890] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C0E-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:34.449808] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215AF-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:34.512482] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=39] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:34.632690] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFFA-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:34.647919] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C0C-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:34.916653] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BFC-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:35.067096] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C10-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:35.174977] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=8] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:35.178199] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=45] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310655174862, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:35.178253] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=50] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310660178249, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:35.179958] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=23] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:35.183066] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=24] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310655179840, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:35.183085] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=17] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310660183084, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:35.214043] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5C-0-0] [lt=10] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310654834167003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310654834167003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310654834167003, v:0}}])
[2024-06-25 18:17:35.263985] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C0F-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:35.442349] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310655031316, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310652676515004, v:0}, replayable_scn:{val:1719310652676515004, v:0}, standby_scn:{val:1719310652676515004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:35.538720] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFA-0-0] [lt=7] start do ObArchiveSchedulerService round(round=3079)
[2024-06-25 18:17:35.539894] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFA-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:35.539910] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFA-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:35.539937] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFA-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:35.539950] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFA-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:35.539955] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFA-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:35.648001] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C0D-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:35.677075] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFF9-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL)
[2024-06-25 18:17:35.692229] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFFA-0-0] [lt=20] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:35.783020] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4AA-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:35.917630] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BFD-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:36.067229] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C11-0-0] [lt=47] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:36.220969] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5D-0-0] [lt=14] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310655835578003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310655835578003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310655835578003, v:0}}])
[2024-06-25 18:17:36.251652] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A548-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:36.264104] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C10-0-0] [lt=46] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:36.633063] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFFB-0-0] [lt=15] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:36.648079] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C0E-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:36.918492] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BFE-0-0] [lt=22] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:37.067338] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C12-0-0] [lt=45] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:37.183355] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFEE-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:37.186952] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B298-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:37.192559] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B299-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:37.193832] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B29A-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:37.194063] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B29B-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:17:37.194307] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B29C-0-0] [lt=9] [DDL] execute ddl like stmt(ret=0, cost=1, ddl_arg=NULL)
[2024-06-25 18:17:37.194737] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B29D-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:37.195115] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B29E-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:37.195366] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B29F-0-0] [lt=4] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:37.226799] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5E-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310656836294003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310656836294003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310656836294003, v:0}}])
[2024-06-25 18:17:37.264187] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C11-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:37.540034] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFB-0-0] [lt=16] start do ObArchiveSchedulerService round(round=3080)
[2024-06-25 18:17:37.541532] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFB-0-0] [lt=16][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:37.541596] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFB-0-0] [lt=62][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:37.541689] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFB-0-0] [lt=29][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:37.541724] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFB-0-0] [lt=34][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:37.541753] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFB-0-0] [lt=27][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:37.600262] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:37.648165] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C0F-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:37.677479] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFFA-0-0] [lt=43] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:37.694407] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFFB-0-0] [lt=15] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:37.783528] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4AB-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:37.802924] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43669][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2A1-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:37.919354] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20BFF-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:38.033974] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310655835578003, v:0}, replayable_scn:{val:1719310655835578003, v:0}, standby_scn:{val:1719310655835578003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310658032234, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310655835578003, v:0}, replayable_scn:{val:1719310655835578003, v:0}, standby_scn:{val:1719310655835578003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310658032234, ora_rowscn_=1719310657229045000)
[2024-06-25 18:17:38.039734] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:38.039755] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310663039751, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:38.067418] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C13-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:38.233315] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C5F-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310657837379003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310657837379003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310657837379003, v:0}}])
[2024-06-25 18:17:38.252137] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A549-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:38.264288] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C12-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:38.444287] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310658032234, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310655835578003, v:0}, replayable_scn:{val:1719310655835578003, v:0}, standby_scn:{val:1719310655835578003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:38.633711] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFFC-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:38.648246] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C10-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:38.920211] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C00-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:39.023306] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215B1-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:39.025009] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215B5-0-0] [lt=22] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:39.025289] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43657][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215B6-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:39.025727] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43661][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215BC-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:39.025974] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43660][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215BD-0-0] [lt=8] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:39.027108] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43656][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215BE-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:39.067500] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C14-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:39.241936] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C60-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310658838194003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310658838194003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310658838194003, v:0}}])
[2024-06-25 18:17:39.264402] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C13-0-0] [lt=43] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:39.541846] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFC-0-0] [lt=17] start do ObArchiveSchedulerService round(round=3081)
[2024-06-25 18:17:39.542910] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFC-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:39.542922] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFC-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:39.542947] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFC-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:39.542960] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFC-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:39.542964] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFC-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:39.648330] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C11-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:39.677845] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFFB-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:39.697036] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFFC-0-0] [lt=20] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:39.783987] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4AC-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL)
[2024-06-25 18:17:39.806973] INFO  [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2244) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65C-0-0] [lt=18] need check schema(new_schema_version=1719298380350128, cached_tenant_schema_version=1719298380350128, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT column_value FROM __all_core_table WHERE TABLE_NAME = ? AND COLUMN_NAME = ? FOR UPDATE)
[2024-06-25 18:17:39.807248] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65C-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1719310659806409000, start_id=1719310659806409000, end_id=1719310659806409001)
[2024-06-25 18:17:39.807549] INFO  [LIB] stat (utility.h:1165) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65C-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=44, this=0x2af442fd1470, extra_info="")
[2024-06-25 18:17:39.807571] INFO  [LIB] stat (utility.h:1165) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65C-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x2af458b6b210, extra_info="id:1")
[2024-06-25 18:17:39.808237] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65C-0-0] [lt=6] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310659806409000, v:0}, tenant_id=1)
[2024-06-25 18:17:39.920944] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C01-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:40.060955] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:17:40.060985] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=27] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:17:40.060993] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=7] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:40.067579] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C15-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:40.086933] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:17:40.086954] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=18] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:17:40.086960] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=6] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:40.178337] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:40.179656] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310660178249, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:40.179675] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310665179674, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:40.183198] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=22] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:40.184833] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310660183084, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:40.184891] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=54] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310665184888, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:40.247775] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C61-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310659839331004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310659839331004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310659839331004, v:0}}])
[2024-06-25 18:17:40.252679] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A54A-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:40.264484] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C14-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:40.505458] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.506019] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.507366] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.540471] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.565772] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.567755] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=24] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.581558] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.634203] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFFD-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:40.648415] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C12-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:40.826361] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF0-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:40.827836] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF3-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL)
[2024-06-25 18:17:40.828234] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF4-0-0] [lt=11] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:40.828622] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.828660] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF5-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:40.829037] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF6-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:17:40.829337] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF7-0-0] [lt=21] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:40.829382] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] failed to get result(ret=-4008)
[2024-06-25 18:17:40.829449] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403704194, start_date_:1718373600000000, last_date_:1718978400000779, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:7054546, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603738087, start_date_:1718632800000000, last_date_:1719237600000767, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:7182242, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306137823202, start_date_:1718269337418154, last_date_:1719306137418936, this_date_:0, next_date_:1719392537418154, end_date_:64060560000000000, total_:2642272, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007201952035, start_date_:1718402400000000, last_date_:1719007200000866, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:4741093, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603749582, start_date_:1718488800000000, last_date_:1719093600000690, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:7242320, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892004284235, start_date_:1718287200000000, last_date_:1718892000000847, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:8227853, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719202175465, start_date_:1718719200000000, last_date_:1718719200000726, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:2174739, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805604724120, start_date_:1718200800000000, last_date_:1718805600000742, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:37147500, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:17:40.829602] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF8-0-0] [lt=9] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:40.829894] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFF9-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:40.831005] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=51] failed to get result(ret=-4008)
[2024-06-25 18:17:40.831054] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403130376, start_date_:1718373600000000, last_date_:1718978400003681, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:6132367, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237601947143, start_date_:1718632800000000, last_date_:1719237600003445, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:5102524, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306194546834, start_date_:1718269394113443, last_date_:1719306194115039, this_date_:0, next_date_:1719392594113443, end_date_:64060560000000000, total_:3284449, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007200659206, start_date_:1718402400000000, last_date_:1719007200007246, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:2269654, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603091085, start_date_:1718488800000000, last_date_:1719093600003492, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:5856845, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892003073665, start_date_:1718287200000000, last_date_:1718892000003898, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:5290345, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719203797237, start_date_:1718719200000000, last_date_:1718719200004208, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:3793029, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805602049343, start_date_:1718200800000000, last_date_:1718805600003825, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:13517012, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:17:40.833937] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=47] failed to get result(ret=-4008)
[2024-06-25 18:17:40.833978] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403755745, start_date_:1718373600000000, last_date_:1718978400009636, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:9178981, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603214741, start_date_:1718632800000000, last_date_:1719237600008773, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:8157181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306206300927, start_date_:1718269406072562, last_date_:1719306206074204, this_date_:0, next_date_:1719392606072562, end_date_:64060560000000000, total_:2552147, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007204300685, start_date_:1718402400000000, last_date_:1719007200014486, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:7423181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093604691429, start_date_:1718488800000000, last_date_:1719093600010541, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:9650110, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892005643742, start_date_:1718287200000000, last_date_:1718892000009893, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:13725944, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719207006246, start_date_:1718719200000000, last_date_:1718719200016920, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:6989326, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805605317652, start_date_:1718200800000000, last_date_:1718805600009364, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:23735393, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:17:40.834027] INFO  [RS] check_all_tenants (ob_dbms_sched_job_master.cpp:631) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=48] check all tenants(ret=0)
[2024-06-25 18:17:40.837410] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=4] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.839932] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.867116] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.868410] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.869623] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.873456] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.884517] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.888019] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.890887] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.894472] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.899496] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.903957] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.909018] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:40.921853] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C02-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:41.034140] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310658838194003, v:0}, replayable_scn:{val:1719310658838194003, v:0}, standby_scn:{val:1719310658838194003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310661031574, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310658838194003, v:0}, replayable_scn:{val:1719310658838194003, v:0}, standby_scn:{val:1719310658838194003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310661031574, ora_rowscn_=1719310660248620001)
[2024-06-25 18:17:41.067662] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C16-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:41.253800] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C62-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310660840086004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310660840086004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310660840086003, v:0}}])
[2024-06-25 18:17:41.264559] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C15-0-0] [lt=12] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:41.306972] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=13] start checking lost replicas
[2024-06-25 18:17:41.446215] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310661031574, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310658838194003, v:0}, replayable_scn:{val:1719310658838194003, v:0}, standby_scn:{val:1719310658838194003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:41.543034] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFD-0-0] [lt=8] start do ObArchiveSchedulerService round(round=3082)
[2024-06-25 18:17:41.544256] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFD-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:41.544272] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFD-0-0] [lt=16][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:41.544300] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFD-0-0] [lt=7][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:41.544313] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFD-0-0] [lt=13][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:41.544319] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFD-0-0] [lt=6][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:41.648503] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C13-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:41.678242] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFFC-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL)
[2024-06-25 18:17:41.705502] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFFD-0-0] [lt=51] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:41.784589] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4AD-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL)
[2024-06-25 18:17:41.922693] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C03-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:42.067745] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C17-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:42.253041] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A54B-0-0] [lt=11] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:17:42.259632] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C63-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310661841876004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310662247739000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310662247739000, v:0}}])
[2024-06-25 18:17:42.264600] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C63-0-0] [lt=13] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310659839331004, v:0})
[2024-06-25 18:17:42.264643] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C16-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:42.634674] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFFE-0-0] [lt=30] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:42.648589] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C14-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:42.923445] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C04-0-0] [lt=25] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:43.039830] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=32] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:43.039850] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310668039846, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:43.067832] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C18-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:43.264733] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C17-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:43.266511] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C64-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310662843068004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310662843068004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310662843068004, v:0}}])
[2024-06-25 18:17:43.270582] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C64-0-0] [lt=22] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310662843068004, v:0}, readable_scn:{val:1719310662843068004, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})
[2024-06-25 18:17:43.404327] INFO  [RS.LB] idle (ob_root_balancer.cpp:103) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420713-0-0] [lt=10] root balance idle(idle_time=10000000)
[2024-06-25 18:17:43.404353] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1936) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=16] start try disaster recovery
[2024-06-25 18:17:43.404360] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=6] start try tenant disaster recovery(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:43.405095] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=7] start try ls disaster recovery(ls_status_info={tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:43.407979] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=15] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:43.408001] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=19] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.408007] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1, ls_id:{id:1}, replicas:[{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:43.408081] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=71] build ls locality stat map(tenant_id=1, ls_id={id:1})
[2024-06-25 18:17:43.408087] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.408095] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=7] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.408098] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.408101] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:43.408159] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=52] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.408167] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.408174] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.408177] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.408997] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:43.409006] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=8] start try tenant disaster recovery(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:43.409496] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] start try ls disaster recovery(ls_status_info={tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:43.411972] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=15] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1001, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:43.411999] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=24] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.412005] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1001, ls_id:{id:1}, replicas:[{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:43.412071] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=64] build ls locality stat map(tenant_id=1001, ls_id={id:1})
[2024-06-25 18:17:43.412076] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.412081] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.412084] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.412087] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:43.412135] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.412142] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.412145] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.412148] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.412968] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:43.414469] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=8] start try tenant disaster recovery(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:43.415845] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=10] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:43.419205] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=15] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:43.419224] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.419229] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1}, replicas:[{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:43.419297] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=66] build ls locality stat map(tenant_id=1002, ls_id={id:1})
[2024-06-25 18:17:43.419303] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.419307] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.419310] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.419315] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:43.419362] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.419368] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.419375] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.419379] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.420165] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:43.426070] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1001}, acc_dr_task=0)
[2024-06-25 18:17:43.426088] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.426093] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1001}, replicas:[{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:43.426159] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=64] build ls locality stat map(tenant_id=1002, ls_id={id:1001})
[2024-06-25 18:17:43.426164] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.426172] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=7] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.426175] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.426179] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:43.426226] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=42] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.426232] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.426239] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.426242] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.427038] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:43.432749] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1002}, acc_dr_task=0)
[2024-06-25 18:17:43.432768] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=16] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.432774] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1002}, replicas:[{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:43.432845] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=70] build ls locality stat map(tenant_id=1002, ls_id={id:1002})
[2024-06-25 18:17:43.432851] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.432855] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.432858] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.432861] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:43.432909] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.432915] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.432918] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.432922] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.433697] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:43.439390] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=11] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1003}, acc_dr_task=0)
[2024-06-25 18:17:43.439408] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.439412] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1003}, replicas:[{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:43.439479] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=65] build ls locality stat map(tenant_id=1002, ls_id={id:1003})
[2024-06-25 18:17:43.439484] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.439488] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.439491] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:43.439494] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:43.439545] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=47] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.439552] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.439556] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.439559] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:43.440328] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=4] try tenant disaster recovery succ(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:43.440338] INFO  [RS] check (ob_migrate_unit_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=8] start check unit migrate finish
[2024-06-25 18:17:43.440344] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=3] try check migrate unit finish by tenant(tenant_id=1)
[2024-06-25 18:17:43.443127] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=6] try check migrate unit finish by tenant(tenant_id=1002)
[2024-06-25 18:17:43.449997] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C0-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:43.455820] INFO  [RS] check (ob_alter_locality_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420714-0-0] [lt=14] start to check alter locality finish
[2024-06-25 18:17:43.456285] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420715-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.456731] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420715-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.457659] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420717-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.458092] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420717-0-0] [lt=11][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.458543] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:72) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420717-0-0] [lt=10] start check shrink resource pool
[2024-06-25 18:17:43.458556] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420718-0-0] [lt=11] start check shrink resource pool(tenant_id=1)
[2024-06-25 18:17:43.458962] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420718-0-0] [lt=5][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.459374] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420718-0-0] [lt=10][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.459402] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420719-0-0] [lt=9] start check shrink resource pool(tenant_id=1002)
[2024-06-25 18:17:43.459805] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420719-0-0] [lt=6][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.460241] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420719-0-0] [lt=9][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.460269] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:100) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420719-0-0] [lt=10] finish check shrink resource pool(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:43.460278] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:49) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420719-0-0] [lt=8] start check primary zone
[2024-06-25 18:17:43.460283] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071A-0-0] [lt=3] start check primary zone(tenant_id=1)
[2024-06-25 18:17:43.460690] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071A-0-0] [lt=5][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.460716] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=9] start check primary zone(tenant_id=1002)
[2024-06-25 18:17:43.461121] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=6][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:43.461148] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:179) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=8] start do unit balance
[2024-06-25 18:17:43.461544] INFO  [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [43229][RootBalance][T1][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=7] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1719310663461531})
[2024-06-25 18:17:43.461673] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C1-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:43.464543] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=10] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:43.464559] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=16] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:43.464562] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:43.464567] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=3] start distribute for server status change
[2024-06-25 18:17:43.464607] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=4] finish distribute for server status change(ret=0)
[2024-06-25 18:17:43.464614] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=6] finish do unit balance(ret=0)
[2024-06-25 18:17:43.467482] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:43.467496] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=14] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:43.467499] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:43.467505] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=3] start to do tenant group unit balance
[2024-06-25 18:17:43.467523] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=6] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:43.467545] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=16] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:43.467558] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=9] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:43.544395] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFE-0-0] [lt=8] start do ObArchiveSchedulerService round(round=3083)
[2024-06-25 18:17:43.545399] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFE-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:43.545414] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFE-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:43.545437] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFE-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:43.545453] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFE-0-0] [lt=15][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:43.545458] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFE-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:43.648672] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C15-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:43.678624] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFFD-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:43.708222] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFFE-0-0] [lt=19] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:43.785228] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4AE-0-0] [lt=43] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:17:43.924303] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C05-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:44.034273] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310662186043000, v:0}, replayable_scn:{val:1719310662186043000, v:0}, standby_scn:{val:1719310662186043000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310664032232, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310662186043000, v:0}, replayable_scn:{val:1719310662186043000, v:0}, standby_scn:{val:1719310662186043000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310664032232, ora_rowscn_=1719310663267924000)
[2024-06-25 18:17:44.067909] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C19-0-0] [lt=11] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:44.253417] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A54C-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:44.264854] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C18-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:44.273064] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C65-0-0] [lt=23] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310663843858003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310663843858003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310663843858003, v:0}}])
[2024-06-25 18:17:44.448426] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310664032232, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310662186043000, v:0}, replayable_scn:{val:1719310662186043000, v:0}, standby_scn:{val:1719310662186043000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:44.635232] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA71FFFF-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:44.648752] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C16-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:44.925164] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C06-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:45.067993] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C1A-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:45.179777] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:45.184111] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=63] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310665179674, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:45.184167] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=51] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310670184163, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:45.184980] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=30] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:45.187750] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=22] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310665184888, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:45.187820] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=66] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310670187817, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:45.264970] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C19-0-0] [lt=46] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:45.280056] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C66-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310664845131003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310664845131003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310664845131003, v:0}}])
[2024-06-25 18:17:45.545534] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFF-0-0] [lt=7] start do ObArchiveSchedulerService round(round=3084)
[2024-06-25 18:17:45.546687] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFF-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:45.546701] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFF-0-0] [lt=13][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:45.546735] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFF-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:45.546744] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFF-0-0] [lt=9][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:45.546750] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB1FFFF-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:45.648836] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C17-0-0] [lt=11] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:45.678984] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFFE-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:45.710857] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA81FFFF-0-0] [lt=28] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:45.785690] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4AF-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:45.925917] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C07-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:46.068095] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C1B-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:46.183576] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFFB-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:46.253820] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A54D-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:46.265050] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C1A-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:46.286456] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C67-0-0] [lt=9] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310665847483002, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310665847483002, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310665847483002, v:0}}])
[2024-06-25 18:17:46.511396] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:46.635797] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720000-0-0] [lt=61] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:46.648916] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C18-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:46.802793] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2A5-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL)
[2024-06-25 18:17:46.926752] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C08-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:47.034565] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310664845131003, v:0}, replayable_scn:{val:1719310664845131003, v:0}, standby_scn:{val:1719310664845131003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310667032171, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310664845131003, v:0}, replayable_scn:{val:1719310664845131003, v:0}, standby_scn:{val:1719310664845131003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310667032171, ora_rowscn_=1719310666289321000)
[2024-06-25 18:17:47.068206] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C1C-0-0] [lt=43] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:47.265137] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C1B-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:47.293108] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C68-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310666848374003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310667251989000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310667251989000, v:0}}])
[2024-06-25 18:17:47.450551] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310667032171, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310664845131003, v:0}, replayable_scn:{val:1719310664845131003, v:0}, standby_scn:{val:1719310664845131003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:47.546823] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20000-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3085)
[2024-06-25 18:17:47.547824] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20000-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:47.547840] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20000-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:47.547864] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20000-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:47.547876] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20000-0-0] [lt=11][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:47.547881] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20000-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:47.648964] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C19-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:47.679551] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF61FFFF-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:47.719217] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820000-0-0] [lt=58] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:47.786493] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B0-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:47.927614] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C09-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:48.039939] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=28] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:48.039958] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310673039953, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:48.068289] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C1D-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:48.254221] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A54E-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:48.265221] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C1C-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:48.300115] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C69-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310667848711003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310667848711003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310667848711003, v:0}}])
[2024-06-25 18:17:48.636208] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720001-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:48.649043] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C1A-0-0] [lt=11] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:48.928385] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C0A-0-0] [lt=27] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:49.068374] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C1E-0-0] [lt=19] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:49.265308] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C1D-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:49.307584] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6A-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310668850463003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310668850463003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310668850463003, v:0}}])
[2024-06-25 18:17:49.547941] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20001-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3086)
[2024-06-25 18:17:49.549102] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20001-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:49.549117] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20001-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:49.549144] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20001-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:49.549158] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20001-0-0] [lt=13][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:49.549163] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20001-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:49.649145] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C1B-0-0] [lt=19] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:49.680114] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620000-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:49.721649] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820001-0-0] [lt=31] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:49.787090] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B1-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:49.810555] INFO  [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2244) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65D-0-0] [lt=14] need check schema(new_schema_version=1719298380350128, cached_tenant_schema_version=1719298380350128, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT column_value FROM __all_core_table WHERE TABLE_NAME = ? AND COLUMN_NAME = ? FOR UPDATE)
[2024-06-25 18:17:49.810792] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65D-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1719310669810512000, start_id=1719310669810512000, end_id=1719310669810512001)
[2024-06-25 18:17:49.812028] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65D-0-0] [lt=13] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310669810512000, v:0}, tenant_id=1)
[2024-06-25 18:17:49.929170] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C0B-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:50.034591] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310668194376000, v:0}, replayable_scn:{val:1719310668194376000, v:0}, standby_scn:{val:1719310668194376000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310670032783, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310668194376000, v:0}, replayable_scn:{val:1719310668194376000, v:0}, standby_scn:{val:1719310668194376000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310670032783, ora_rowscn_=1719310669312693000)
[2024-06-25 18:17:50.061251] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:17:50.061268] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=14] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:17:50.061274] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=6] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:50.068489] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C1F-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:50.089092] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=5] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:17:50.089146] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=48] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:17:50.089173] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=25] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:17:50.184245] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=8] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:50.185704] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310670184163, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:50.185726] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=20] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310675185724, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:50.187891] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:50.189197] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310670187817, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:50.189211] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310675189210, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:50.254623] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A54F-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:50.265397] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C1E-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:50.314829] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6B-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310669851617003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310669851617003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310669851617003, v:0}}])
[2024-06-25 18:17:50.452513] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310670032783, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310668194376000, v:0}, replayable_scn:{val:1719310668194376000, v:0}, standby_scn:{val:1719310668194376000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:50.636703] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720002-0-0] [lt=15] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:50.649231] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C1C-0-0] [lt=20] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:50.932069] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C0C-0-0] [lt=9] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:51.068598] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C20-0-0] [lt=44] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:51.265482] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C1F-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:51.314532] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=40] start checking lost replicas
[2024-06-25 18:17:51.321911] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6C-0-0] [lt=17] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310670851898003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310670851898003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310670851898003, v:0}}])
[2024-06-25 18:17:51.549233] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20002-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3087)
[2024-06-25 18:17:51.550225] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20002-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:51.550239] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20002-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:51.550267] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20002-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:51.550279] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20002-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:51.550284] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20002-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:51.649310] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C1D-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:51.680483] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620001-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:51.724278] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820002-0-0] [lt=21] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:51.787566] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B2-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:51.932938] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C0D-0-0] [lt=43] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:52.068681] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C21-0-0] [lt=19] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:52.191776] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2A6-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:52.192980] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2A7-0-0] [lt=28] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:52.193274] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2A8-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:52.194124] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2A9-0-0] [lt=4] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:52.194547] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2AA-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:52.194958] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2AB-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:52.195546] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2AC-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:52.255225] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A550-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:52.265560] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C20-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:52.327846] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6D-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310671853189003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310672256634000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310672256634000, v:0}}])
[2024-06-25 18:17:52.332025] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6D-0-0] [lt=8] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310670196596001, v:0})
[2024-06-25 18:17:52.450283] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C3-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:52.637083] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720003-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:52.649396] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C1E-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:52.933809] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C0E-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:53.034951] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310671198128001, v:0}, replayable_scn:{val:1719310671198128001, v:0}, standby_scn:{val:1719310671198128001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310673032388, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310671198128001, v:0}, replayable_scn:{val:1719310671198128001, v:0}, standby_scn:{val:1719310671198128001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310673032388, ora_rowscn_=1719310672335158000)
[2024-06-25 18:17:53.040085] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:53.040135] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=38] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310678040126, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:53.068762] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C22-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:53.265643] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C21-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:53.333732] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6E-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310672854023003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310672854023003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310672854023003, v:0}}])
[2024-06-25 18:17:53.338226] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6E-0-0] [lt=12] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310672854023003, v:0}, readable_scn:{val:1719310672854023003, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})
[2024-06-25 18:17:53.454623] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310673032388, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310671198128001, v:0}, replayable_scn:{val:1719310671198128001, v:0}, standby_scn:{val:1719310671198128001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:53.467224] INFO  [RS.LB] idle (ob_root_balancer.cpp:103) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071B-0-0] [lt=9] root balance idle(idle_time=10000000)
[2024-06-25 18:17:53.467248] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1936) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=14] start try disaster recovery
[2024-06-25 18:17:53.467254] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] start try tenant disaster recovery(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:53.467989] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=6] start try ls disaster recovery(ls_status_info={tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:53.470770] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=16] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:53.470799] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=26] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.470804] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1, ls_id:{id:1}, replicas:[{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:53.470877] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=70] build ls locality stat map(tenant_id=1, ls_id={id:1})
[2024-06-25 18:17:53.470883] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.470889] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.470892] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.470897] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:53.470947] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.470954] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.470960] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.470963] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.471802] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] try tenant disaster recovery succ(tenant_id=1, only_for_display=false)
[2024-06-25 18:17:53.471811] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=9] start try tenant disaster recovery(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:53.472306] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:53.474761] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=14] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1001, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:53.474789] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=19] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.474794] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1001, ls_id:{id:1}, replicas:[{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:53.474859] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=63] build ls locality stat map(tenant_id=1001, ls_id={id:1})
[2024-06-25 18:17:53.474864] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.474869] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.474872] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.474876] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:53.474924] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.474933] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.474939] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.474943] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.475720] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1001, only_for_display=false)
[2024-06-25 18:17:53.477282] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=8] start try tenant disaster recovery(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:53.478541] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=9] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:53.481727] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=12] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:17:53.481746] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=16] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.481751] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1}, replicas:[{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:53.481825] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=72] build ls locality stat map(tenant_id=1002, ls_id={id:1})
[2024-06-25 18:17:53.481830] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.481834] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.481838] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.481842] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:53.481889] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.481896] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.481902] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.481905] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.482676] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:53.488523] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1001}, acc_dr_task=0)
[2024-06-25 18:17:53.488541] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=15] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.488546] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1001}, replicas:[{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:53.488611] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=64] build ls locality stat map(tenant_id=1002, ls_id={id:1001})
[2024-06-25 18:17:53.488617] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.488621] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.488624] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.488627] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:53.488674] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.488681] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.488684] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.488687] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.489464] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:53.495353] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1002}, acc_dr_task=0)
[2024-06-25 18:17:53.495373] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=18] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.495379] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1002}, replicas:[{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:53.495444] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=63] build ls locality stat map(tenant_id=1002, ls_id={id:1002})
[2024-06-25 18:17:53.495450] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.495454] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.495457] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.495462] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:53.495510] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=44] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.495517] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.495520] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.495523] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.496295] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:17:53.501968] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1003}, acc_dr_task=0)
[2024-06-25 18:17:53.501987] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=16] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.501992] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1003}, replicas:[{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:17:53.502057] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=63] build ls locality stat map(tenant_id=1002, ls_id={id:1003})
[2024-06-25 18:17:53.502062] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.502067] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.502070] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:17:53.502073] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:17:53.502117] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=40] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.502123] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.502126] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.502129] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:17:53.502897] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=2] try tenant disaster recovery succ(tenant_id=1002, only_for_display=false)
[2024-06-25 18:17:53.502908] INFO  [RS] check (ob_migrate_unit_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=9] start check unit migrate finish
[2024-06-25 18:17:53.502915] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=4] try check migrate unit finish by tenant(tenant_id=1)
[2024-06-25 18:17:53.505639] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=3] try check migrate unit finish by tenant(tenant_id=1002)
[2024-06-25 18:17:53.521015] INFO  [RS] check (ob_alter_locality_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071C-0-0] [lt=14] start to check alter locality finish
[2024-06-25 18:17:53.521495] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071D-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.521959] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071D-0-0] [lt=21][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.522842] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071F-0-0] [lt=11][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.523287] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071F-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.523758] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:72) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42071F-0-0] [lt=12] start check shrink resource pool
[2024-06-25 18:17:53.523772] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420720-0-0] [lt=11] start check shrink resource pool(tenant_id=1)
[2024-06-25 18:17:53.524198] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420720-0-0] [lt=3][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.524608] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420720-0-0] [lt=6][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.524640] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420721-0-0] [lt=12] start check shrink resource pool(tenant_id=1002)
[2024-06-25 18:17:53.525045] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420721-0-0] [lt=3][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.525480] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420721-0-0] [lt=10][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.525508] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:100) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420721-0-0] [lt=10] finish check shrink resource pool(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:53.525513] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:49) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420721-0-0] [lt=5] start check primary zone
[2024-06-25 18:17:53.525519] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420722-0-0] [lt=4] start check primary zone(tenant_id=1)
[2024-06-25 18:17:53.525929] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420722-0-0] [lt=3][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.525955] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=9] start check primary zone(tenant_id=1002)
[2024-06-25 18:17:53.526346] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=3][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:17:53.526374] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:179) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=10] start do unit balance
[2024-06-25 18:17:53.526769] INFO  [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [43229][RootBalance][T1][YB420A0A0A33-00061BB2CC420723-0-0] [lt=6] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1719310673526760})
[2024-06-25 18:17:53.526906] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C4-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:53.529865] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=19] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:53.529879] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=14] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:53.529883] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:53.529887] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=2] start distribute for server status change
[2024-06-25 18:17:53.529926] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=3] finish distribute for server status change(ret=0)
[2024-06-25 18:17:53.529933] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=7] finish do unit balance(ret=0)
[2024-06-25 18:17:53.533311] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:17:53.533327] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=15] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:17:53.533331] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:17:53.533337] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=3] start to do tenant group unit balance
[2024-06-25 18:17:53.533355] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=3] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:53.533377] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=17] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:53.533391] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=10] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:17:53.550358] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20003-0-0] [lt=8] start do ObArchiveSchedulerService round(round=3088)
[2024-06-25 18:17:53.551367] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20003-0-0] [lt=16][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:53.551381] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20003-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:53.551405] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20003-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:53.551417] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20003-0-0] [lt=11][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:53.551422] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20003-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:53.649486] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C1F-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:53.680963] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620002-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:53.726983] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820003-0-0] [lt=18] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:53.788325] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B3-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:53.934624] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C0F-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:54.023115] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C5-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:54.026435] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C6-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:54.026834] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43661][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215C7-0-0] [lt=10] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:54.027022] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43661][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215CA-0-0] [lt=9] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:17:54.027391] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43661][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215D0-0-0] [lt=7] [DDL] execute ddl like stmt(ret=0, cost=41, ddl_arg=NULL)
[2024-06-25 18:17:54.027595] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215D1-0-0] [lt=20] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:54.027759] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43656][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215D2-0-0] [lt=9] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:54.068839] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C23-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:54.255612] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A551-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:17:54.265726] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C22-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:54.340304] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C6F-0-0] [lt=19] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310673855448003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310673855448003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310673855448003, v:0}}])
[2024-06-25 18:17:54.514081] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:54.637458] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720004-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:54.649570] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C20-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:54.935353] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C10-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:55.068890] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C24-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:55.183730] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFFD-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:55.185802] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=36] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:55.187324] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310675185724, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:17:55.187344] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310680187342, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:17:55.189295] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:55.190678] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310675189210, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:17:55.190694] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310680190693, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:55.265808] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C23-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:55.346537] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C70-0-0] [lt=10] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310674856685003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310674856685003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310674856685003, v:0}}])
[2024-06-25 18:17:55.551555] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20004-0-0] [lt=6] start do ObArchiveSchedulerService round(round=3089)
[2024-06-25 18:17:55.552584] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20004-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:55.552600] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20004-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:55.552623] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20004-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:55.552634] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20004-0-0] [lt=11][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:55.552639] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20004-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:55.649669] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C21-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:55.681338] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620003-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:17:55.729584] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820004-0-0] [lt=19] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:55.788942] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B4-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL)
[2024-06-25 18:17:55.802987] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2AE-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:17:55.832001] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23BFFE-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:17:55.833398] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C001-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:17:55.834210] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C002-0-0] [lt=2] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:55.834570] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C003-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:55.834935] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C004-0-0] [lt=31] [DDL] execute ddl like stmt(ret=0, cost=79, ddl_arg=NULL)
[2024-06-25 18:17:55.835324] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C005-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:17:55.835607] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C006-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:17:55.835883] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C007-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:17:55.936201] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C11-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:56.036898] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310674201766001, v:0}, replayable_scn:{val:1719310674201766001, v:0}, standby_scn:{val:1719310674201766001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310676032574, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310674201766001, v:0}, replayable_scn:{val:1719310674201766001, v:0}, standby_scn:{val:1719310674201766001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310676032574, ora_rowscn_=1719310675352185000)
[2024-06-25 18:17:56.068970] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C25-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:56.256045] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A552-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:56.265890] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C24-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:56.353038] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C71-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310675869595003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310675869595003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310675869595003, v:0}}])
[2024-06-25 18:17:56.456665] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310676032574, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310674201766001, v:0}, replayable_scn:{val:1719310674201766001, v:0}, standby_scn:{val:1719310674201766001, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:56.637973] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720005-0-0] [lt=15] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:56.649777] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C22-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:56.937071] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C12-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:57.069051] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C26-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:57.204344] INFO  [SHARE] get_jobs (ob_backup_data_table_operator.cpp:714) [43481][T1_BackupDataSr][T1][YB420A0A0A33-00061BB2CA91F4C3-0-0] [lt=14] [DATA_BACKUP]success get jobs(job_attrs=[])
[2024-06-25 18:17:57.205812] INFO  [RS.RESTORE] do_work (ob_restore_scheduler.cpp:126) [43478][T1_REST_SER][T1][YB420A0A0A33-00061BB2CA61F527-0-0] [lt=11] [RESTORE] restore scheduler quit
[2024-06-25 18:17:57.206368] INFO  [SHARE] get_all_recover_table_job (ob_recover_table_persist_helper.cpp:199) [43478][T1_REST_SER][T1][YB420A0A0A33-00061BB2CA61F527-0-0] [lt=13] get targets(ret=0, jobs=[], exec_tenant_id=1, sql=select * from __all_recover_table_job)
[2024-06-25 18:17:57.206391] WDIAG [SHARE.SCHEMA] revert (ob_schema_mgr_cache.cpp:122) [43478][T1_REST_SER][T1][YB420A0A0A33-00061BB2CA61F528-0-0] [lt=16][errcode=0] long time to hold one guard(schema_mgr=0x2af4d8115260, tenant_id=1, version=1719298380350128, cur_timestamp=1719310677206386, ref_timestamp=1719310617204993, lbt()="0x17a30451 0x1523bc9f 0x5f9b859 0x5f9bdc0 0x5ff915f 0xac59643 0x8f5ffef 0x62d7da4 0x17b107dc 0x17b1be21 0x17b1814e 0x2af40bb83ea5 0x2af40be96b0d")
[2024-06-25 18:17:57.206472] INFO  [RS.RESTORE] do_work (ob_restore_scheduler.cpp:95) [43478][T1_REST_SER][T1][YB420A0A0A33-00061BB2CA61F529-0-0] [lt=8] [RESTORE] restore scheduler start
[2024-06-25 18:17:57.206480] INFO  [RS.RESTORE] do_work (ob_restore_scheduler.cpp:102) [43478][T1_REST_SER][T1][YB420A0A0A33-00061BB2CA61F52A-0-0] [lt=8] [RESTORE] try process restore job
[2024-06-25 18:17:57.206970] INFO  [COMMON] get_jobs (ob_physical_restore_table_operator.cpp:416) [43478][T1_REST_SER][T1][YB420A0A0A33-00061BB2CA61F52A-0-0] [lt=2] [RESTORE] get restore jobs(ret=0, job_cnt=0)
[2024-06-25 18:17:57.265973] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C25-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:57.362386] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C72-0-0] [lt=25] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310677261627000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310677261627000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310677261627000, v:0}}])
[2024-06-25 18:17:57.552719] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20005-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3090)
[2024-06-25 18:17:57.553744] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20005-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:57.553757] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20005-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:57.553780] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20005-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:57.553798] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20005-0-0] [lt=17][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:57.553802] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20005-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:57.601022] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:17:57.649910] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C23-0-0] [lt=64] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:57.681696] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620004-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:57.731853] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820005-0-0] [lt=18] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:57.789409] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B5-0-0] [lt=20] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:57.920275] INFO  [RS] remove_inactive_ddl_task (ob_ddl_scheduler.cpp:2112) [44237][HeartBeatCheckT][T0][Y0-0000000000000000-0-0] [lt=5] need remove task(remove_task_ids=[])
[2024-06-25 18:17:57.920294] INFO  [RS] remove_inactive_ddl_task (ob_ddl_scheduler.cpp:2131) [44237][HeartBeatCheckT][T0][Y0-0000000000000000-0-0] [lt=17] remove all timeout ddl task succeed
[2024-06-25 18:17:57.937868] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C13-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:58.040208] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:17:58.040229] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310683040225, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:17:58.069129] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C27-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:58.256501] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A553-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:58.266069] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C26-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:58.368692] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C73-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310677859697004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310677859697004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310677859697004, v:0}}])
[2024-06-25 18:17:58.638373] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720006-0-0] [lt=16] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:58.649993] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C24-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:58.703327] INFO  [RS] recover_task (ob_ddl_scheduler.cpp:2040) [44236][DDLScanTask][T0][Y0-0000000000000000-0-0] [lt=11] start processing ddl recovery(ddl_event_info={addr_:"10.10.10.51:2882", event_ts_:1719310678703326, sub_id_:0, trace_id_:Y0-0000000000000000-0-0, parent_trace_id_:Y0-0000000000000000-0-0}, task_records=[], primary_tenant_ids=[1002])
[2024-06-25 18:17:58.938754] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C14-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:17:59.043037] INFO  [RS] inner_dump_statistic_ (ob_disaster_recovery_task_mgr.cpp:1286) [43235][DRTaskMgr][T0][Y0-0000000000000000-0-0] [lt=47] [DRTASK_NOTICE] disaster recovery task manager statistics(waiting_high_priority_task_cnt=0, executing_high_priority_task_cnt=0, waiting_low_priority_task_cnt=0, executing_low_priority_task_cnt=0)
[2024-06-25 18:17:59.069221] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C28-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:59.266156] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C27-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:59.274432] INFO  [RS] process (ob_root_inspection.cpp:496) [43224][RSInspectTask][T0][Y0-00061BB2D3121C8C-0-0] [lt=3] purge recyclebin task begin
[2024-06-25 18:17:59.274452] INFO  [RS] process (ob_root_inspection.cpp:513) [43224][RSInspectTask][T0][Y0-00061BB2D3121C8C-0-0] [lt=12] submit purge recyclebin task success(delay=60000000)
[2024-06-25 18:17:59.274457] INFO  [RS] process (ob_root_inspection.cpp:515) [43224][RSInspectTask][T0][Y0-00061BB2D3121C8C-0-0] [lt=5] purge recyclebin task end(delay=60000000)
[2024-06-25 18:17:59.374780] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C74-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310678860006004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310678860006004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310678860006004, v:0}}])
[2024-06-25 18:17:59.458602] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310679032880, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310677205334002, v:0}, replayable_scn:{val:1719310677205334002, v:0}, standby_scn:{val:1719310677205334002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:17:59.553850] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20006-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3091)
[2024-06-25 18:17:59.557858] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20006-0-0] [lt=31][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:17:59.557900] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20006-0-0] [lt=39][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:17:59.558003] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20006-0-0] [lt=19][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:59.558041] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20006-0-0] [lt=36][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:17:59.558071] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20006-0-0] [lt=29][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:17:59.650082] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C25-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:59.682074] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620005-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:17:59.734128] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820006-0-0] [lt=16] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:17:59.789904] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B6-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:17:59.814739] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65E-0-0] [lt=14] get number(ret=0, service_type_=0, range=1, base_id=1719310679814087000, start_id=1719310679814087000, end_id=1719310679814087001)
[2024-06-25 18:17:59.815833] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65E-0-0] [lt=25] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310679814087000, v:0}, tenant_id=1)
[2024-06-25 18:17:59.939520] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C15-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:00.035252] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=82] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310677859697004, v:0}, replayable_scn:{val:1719310677859697004, v:0}, standby_scn:{val:1719310677859697004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310680033373, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310677859697004, v:0}, replayable_scn:{val:1719310677859697004, v:0}, standby_scn:{val:1719310677859697004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310680033373, ora_rowscn_=1719310679377169001)
[2024-06-25 18:18:00.062614] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:18:00.062636] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=19] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:18:00.062643] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=6] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:18:00.069312] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C29-0-0] [lt=19] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:00.090574] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=22] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:18:00.090597] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=20] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:18:00.090606] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=9] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:18:00.187430] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:00.189090] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310680187342, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:18:00.189113] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=20] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310685189110, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:18:00.190777] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=8] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:00.192228] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310680190693, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:18:00.192248] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310685192246, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:00.256953] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A554-0-0] [lt=20] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL)
[2024-06-25 18:18:00.266241] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C28-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:00.380823] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C75-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310679861356004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310679861356004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310679861356004, v:0}}])
[2024-06-25 18:18:00.506301] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.506976] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.508022] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.541092] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.566479] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.568308] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.582175] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.638754] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720007-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:00.650181] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C26-0-0] [lt=18] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:00.830384] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.831079] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] failed to get result(ret=-4008)
[2024-06-25 18:18:00.831133] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=17] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403704194, start_date_:1718373600000000, last_date_:1718978400000779, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:7054546, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603738087, start_date_:1718632800000000, last_date_:1719237600000767, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:7182242, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306137823202, start_date_:1718269337418154, last_date_:1719306137418936, this_date_:0, next_date_:1719392537418154, end_date_:64060560000000000, total_:2642272, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007201952035, start_date_:1718402400000000, last_date_:1719007200000866, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:4741093, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603749582, start_date_:1718488800000000, last_date_:1719093600000690, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:7242320, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892004284235, start_date_:1718287200000000, last_date_:1718892000000847, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:8227853, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719202175465, start_date_:1718719200000000, last_date_:1718719200000726, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:2174739, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805604724120, start_date_:1718200800000000, last_date_:1718805600000742, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:37147500, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:18:00.832512] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=50] failed to get result(ret=-4008)
[2024-06-25 18:18:00.832549] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403130376, start_date_:1718373600000000, last_date_:1718978400003681, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:6132367, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237601947143, start_date_:1718632800000000, last_date_:1719237600003445, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:5102524, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306194546834, start_date_:1718269394113443, last_date_:1719306194115039, this_date_:0, next_date_:1719392594113443, end_date_:64060560000000000, total_:3284449, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007200659206, start_date_:1718402400000000, last_date_:1719007200007246, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:2269654, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603091085, start_date_:1718488800000000, last_date_:1719093600003492, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:5856845, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892003073665, start_date_:1718287200000000, last_date_:1718892000003898, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:5290345, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719203797237, start_date_:1718719200000000, last_date_:1718719200004208, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:3793029, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805602049343, start_date_:1718200800000000, last_date_:1718805600003825, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:13517012, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:18:00.835892] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=45] failed to get result(ret=-4008)
[2024-06-25 18:18:00.835931] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403755745, start_date_:1718373600000000, last_date_:1718978400009636, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:9178981, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603214741, start_date_:1718632800000000, last_date_:1719237600008773, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:8157181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306206300927, start_date_:1718269406072562, last_date_:1719306206074204, this_date_:0, next_date_:1719392606072562, end_date_:64060560000000000, total_:2552147, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007204300685, start_date_:1718402400000000, last_date_:1719007200014486, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:7423181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093604691429, start_date_:1718488800000000, last_date_:1719093600010541, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:9650110, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892005643742, start_date_:1718287200000000, last_date_:1718892000009893, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:13725944, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719207006246, start_date_:1718719200000000, last_date_:1718719200016920, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:6989326, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805605317652, start_date_:1718200800000000, last_date_:1718805600009364, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:23735393, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:18:00.835977] INFO  [RS] check_all_tenants (ob_dbms_sched_job_master.cpp:631) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=45] check all tenants(ret=0)
[2024-06-25 18:18:00.838793] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=4] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.841280] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.868648] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.869986] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.871238] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.874742] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.885947] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.889443] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.892297] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.895955] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.900844] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.905308] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.910613] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:00.940249] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C16-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:00.973522] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2AF-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:01.069395] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C2A-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:01.266325] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C29-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:01.317129] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=16] start checking lost replicas
[2024-06-25 18:18:01.386879] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C76-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310680991306003, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310680991306003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310680991306003, v:0}}])
[2024-06-25 18:18:01.450433] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215D6-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:01.558157] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20007-0-0] [lt=16] start do ObArchiveSchedulerService round(round=3092)
[2024-06-25 18:18:01.559520] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20007-0-0] [lt=18][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:01.559536] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20007-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:01.559565] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20007-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:01.559575] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20007-0-0] [lt=10][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:01.559580] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20007-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:01.650257] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C27-0-0] [lt=12] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:01.682447] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620006-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:01.736629] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820007-0-0] [lt=20] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:01.790412] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B7-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:01.941006] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C17-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:02.069484] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C2B-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:02.257380] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A555-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:18:02.266414] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C2A-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:02.393865] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C77-0-0] [lt=10] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310682266476001, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310682266476001, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310682266476001, v:0}}])
[2024-06-25 18:18:02.398533] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C77-0-0] [lt=15] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310679861356004, v:0})
[2024-06-25 18:18:02.460432] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310682033298, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310679861356004, v:0}, replayable_scn:{val:1719310679861356004, v:0}, standby_scn:{val:1719310679861356004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:02.639162] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720008-0-0] [lt=10] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:02.650342] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C28-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:02.941904] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C18-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:03.035741] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310680991306003, v:0}, replayable_scn:{val:1719310680991306003, v:0}, standby_scn:{val:1719310680991306003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310683033170, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310680991306003, v:0}, replayable_scn:{val:1719310680991306003, v:0}, standby_scn:{val:1719310680991306003, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310683033170, ora_rowscn_=1719310682395519001)
[2024-06-25 18:18:03.040316] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:03.040337] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310688040332, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:03.069570] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C2C-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:03.266492] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C2B-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:03.400365] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C78-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310682864095004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310682864095004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310682864095004, v:0}}])
[2024-06-25 18:18:03.404176] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C78-0-0] [lt=11] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310682864095004, v:0}, readable_scn:{val:1719310682864095004, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})
[2024-06-25 18:18:03.533083] INFO  [RS.LB] idle (ob_root_balancer.cpp:103) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420723-0-0] [lt=9] root balance idle(idle_time=10000000)
[2024-06-25 18:18:03.533107] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1936) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=15] start try disaster recovery
[2024-06-25 18:18:03.533114] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] start try tenant disaster recovery(tenant_id=1, only_for_display=false)
[2024-06-25 18:18:03.533771] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=7] start try ls disaster recovery(ls_status_info={tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:03.536632] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=26] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:18:03.536653] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.536659] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1, ls_id:{id:1}, replicas:[{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:03.536731] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=69] build ls locality stat map(tenant_id=1, ls_id={id:1})
[2024-06-25 18:18:03.536737] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.536742] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.536745] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.536749] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:03.536807] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=51] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.536814] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.536821] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.536824] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.537674] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1, only_for_display=false)
[2024-06-25 18:18:03.537685] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=10] start try tenant disaster recovery(tenant_id=1001, only_for_display=false)
[2024-06-25 18:18:03.538188] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] start try ls disaster recovery(ls_status_info={tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:03.540877] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=14] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1001, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:18:03.540896] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.540902] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1001, ls_id:{id:1}, replicas:[{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:03.540971] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=67] build ls locality stat map(tenant_id=1001, ls_id={id:1})
[2024-06-25 18:18:03.540977] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.540983] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.540986] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.540989] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:03.541037] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.541044] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.541048] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.541051] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.541862] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] try tenant disaster recovery succ(tenant_id=1001, only_for_display=false)
[2024-06-25 18:18:03.543131] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=8] start try tenant disaster recovery(tenant_id=1002, only_for_display=false)
[2024-06-25 18:18:03.544303] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=11] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:03.547459] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=14] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:18:03.547481] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=19] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.547486] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1}, replicas:[{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:03.547553] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=65] build ls locality stat map(tenant_id=1002, ls_id={id:1})
[2024-06-25 18:18:03.547559] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.547563] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.547567] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.547571] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:03.547618] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.547624] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.547628] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.547631] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.548468] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:03.554241] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1001}, acc_dr_task=0)
[2024-06-25 18:18:03.554262] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.554267] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1001}, replicas:[{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:03.554339] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=71] build ls locality stat map(tenant_id=1002, ls_id={id:1001})
[2024-06-25 18:18:03.554345] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.554349] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.554352] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.554355] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:03.554402] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.554409] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.554416] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.554419] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.555199] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:03.559662] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20008-0-0] [lt=10] start do ObArchiveSchedulerService round(round=3093)
[2024-06-25 18:18:03.560651] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20008-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:03.560668] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20008-0-0] [lt=17][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:03.560692] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20008-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:03.560704] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20008-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:03.560709] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20008-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:03.562384] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=10] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1002}, acc_dr_task=0)
[2024-06-25 18:18:03.562406] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=19] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.562411] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1002}, replicas:[{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:03.562482] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=69] build ls locality stat map(tenant_id=1002, ls_id={id:1002})
[2024-06-25 18:18:03.562488] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.562493] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.562495] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.562498] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:03.562546] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.562552] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.562557] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.562560] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.563344] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:03.569365] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=11] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1003}, acc_dr_task=0)
[2024-06-25 18:18:03.569385] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.569390] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1003}, replicas:[{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:03.569456] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=64] build ls locality stat map(tenant_id=1002, ls_id={id:1003})
[2024-06-25 18:18:03.569461] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.569465] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.569469] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:03.569472] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:03.569519] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=43] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.569526] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.569530] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=3] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.569534] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:03.570317] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=2] try tenant disaster recovery succ(tenant_id=1002, only_for_display=false)
[2024-06-25 18:18:03.570326] INFO  [RS] check (ob_migrate_unit_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=8] start check unit migrate finish
[2024-06-25 18:18:03.570334] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=4] try check migrate unit finish by tenant(tenant_id=1)
[2024-06-25 18:18:03.573160] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=5] try check migrate unit finish by tenant(tenant_id=1002)
[2024-06-25 18:18:03.586416] INFO  [RS] check (ob_alter_locality_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420724-0-0] [lt=13] start to check alter locality finish
[2024-06-25 18:18:03.586900] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420725-0-0] [lt=14][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.587345] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420725-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.588267] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420727-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.588703] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420727-0-0] [lt=13][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.589176] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:72) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420727-0-0] [lt=11] start check shrink resource pool
[2024-06-25 18:18:03.589191] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420728-0-0] [lt=12] start check shrink resource pool(tenant_id=1)
[2024-06-25 18:18:03.589627] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420728-0-0] [lt=4][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.590067] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420728-0-0] [lt=10][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.590100] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420729-0-0] [lt=10] start check shrink resource pool(tenant_id=1002)
[2024-06-25 18:18:03.590503] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420729-0-0] [lt=6][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.590926] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420729-0-0] [lt=9][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.590953] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:100) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420729-0-0] [lt=9] finish check shrink resource pool(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:03.590961] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:49) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420729-0-0] [lt=8] start check primary zone
[2024-06-25 18:18:03.590967] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072A-0-0] [lt=4] start check primary zone(tenant_id=1)
[2024-06-25 18:18:03.591387] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072A-0-0] [lt=5][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.591415] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=10] start check primary zone(tenant_id=1002)
[2024-06-25 18:18:03.591836] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=7][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:03.591864] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:179) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=9] start do unit balance
[2024-06-25 18:18:03.592292] INFO  [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [43229][RootBalance][T1][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=7] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1719310683592282})
[2024-06-25 18:18:03.592436] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215D9-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:18:03.595411] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=10] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:18:03.595427] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=15] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:18:03.595430] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:18:03.595434] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=2] start distribute for server status change
[2024-06-25 18:18:03.595477] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=5] finish distribute for server status change(ret=0)
[2024-06-25 18:18:03.595484] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=6] finish do unit balance(ret=0)
[2024-06-25 18:18:03.598662] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:18:03.598676] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=13] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:18:03.598679] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:18:03.598686] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=3] start to do tenant group unit balance
[2024-06-25 18:18:03.598703] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=4] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:18:03.598726] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=17] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:18:03.598739] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=9] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:18:03.650426] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C29-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:03.682833] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620007-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL)
[2024-06-25 18:18:03.739279] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820008-0-0] [lt=20] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:03.790914] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B8-0-0] [lt=23] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:03.942627] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C19-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:04.069658] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C2D-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:04.183983] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C009-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:04.257853] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A556-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:18:04.266579] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C2C-0-0] [lt=10] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:04.406390] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C79-0-0] [lt=19] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310683864983004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310683864983004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310683864983004, v:0}}])
[2024-06-25 18:18:04.639668] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720009-0-0] [lt=21] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:04.650516] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C2A-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:04.803331] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2B2-0-0] [lt=20] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:04.943479] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C1A-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:05.069744] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C2E-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:05.189264] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:05.192619] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=46] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310685189110, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:18:05.192699] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=75] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310690192695, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:18:05.196902] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=21] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310685192246, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:18:05.196955] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=49] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310690196952, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:05.266662] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C2D-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:05.412746] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C7A-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310684865706004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310684865706004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310684865706004, v:0}}])
[2024-06-25 18:18:05.462454] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310685034136, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310682864095004, v:0}, replayable_scn:{val:1719310682864095004, v:0}, standby_scn:{val:1719310682864095004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:05.560792] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20009-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3094)
[2024-06-25 18:18:05.562029] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20009-0-0] [lt=17][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:05.562038] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20009-0-0] [lt=9][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:05.562066] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20009-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:05.562081] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20009-0-0] [lt=14][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:05.562089] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20009-0-0] [lt=7][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:05.650599] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C2B-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:05.683384] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620008-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL)
[2024-06-25 18:18:05.743738] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820009-0-0] [lt=19] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:05.791559] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4B9-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:05.944328] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C1B-0-0] [lt=60] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:06.035996] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310683864983004, v:0}, replayable_scn:{val:1719310683864983004, v:0}, standby_scn:{val:1719310683864983004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310686034150, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310683864983004, v:0}, replayable_scn:{val:1719310683864983004, v:0}, standby_scn:{val:1719310683864983004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310686034150, ora_rowscn_=1719310685414253001)
[2024-06-25 18:18:06.069824] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C2F-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:06.258241] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A557-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:06.266772] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C2E-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:06.419090] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C7B-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310685894422004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310685894422004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310685894422004, v:0}}])
[2024-06-25 18:18:06.514586] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:06.640106] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA72000A-0-0] [lt=13] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:06.650679] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C2C-0-0] [lt=10] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:06.945188] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C1C-0-0] [lt=20] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:07.069923] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C30-0-0] [lt=19] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:07.186979] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2B4-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:07.192591] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2B5-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:18:07.194499] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2B8-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:07.194822] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2B9-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=1, ddl_arg=NULL)
[2024-06-25 18:18:07.195373] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2BA-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:18:07.195792] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43656][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2BB-0-0] [lt=2] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL)
[2024-06-25 18:18:07.196104] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2BC-0-0] [lt=7] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:07.196322] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2BD-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:18:07.196553] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2BE-0-0] [lt=8] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:07.196977] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2BF-0-0] [lt=9] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:18:07.197281] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2C0-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:07.266863] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C2F-0-0] [lt=23] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:07.425214] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C7C-0-0] [lt=21] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310687271351000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310687271351000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310687271351000, v:0}}])
[2024-06-25 18:18:07.562125] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000A-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3095)
[2024-06-25 18:18:07.563370] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000A-0-0] [lt=18][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:07.563385] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000A-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:07.563414] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000A-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:07.563427] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000A-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:07.563433] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000A-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:07.650761] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C2D-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:07.683925] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620009-0-0] [lt=44] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:18:07.746010] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA82000A-0-0] [lt=16] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:07.792067] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4BA-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:07.946067] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C1D-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:08.040428] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=21] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:08.040454] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=20] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310693040450, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:08.070002] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C31-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:08.258661] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A558-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:08.266940] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C30-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:08.432823] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C7D-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310687868647004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310687868647004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310687868647004, v:0}}])
[2024-06-25 18:18:08.464482] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310688033792, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310685894422004, v:0}, replayable_scn:{val:1719310685894422004, v:0}, standby_scn:{val:1719310685894422004, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:08.640562] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA72000B-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:08.650841] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C2E-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:08.946846] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C1E-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:09.022955] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215DB-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:09.024358] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215DC-0-0] [lt=11] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:18:09.024768] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215DD-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:18:09.024971] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43656][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215DE-0-0] [lt=10] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:09.025467] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43659][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215E4-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:18:09.025703] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43663][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215E5-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL)
[2024-06-25 18:18:09.026055] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43666][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215E6-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:09.026242] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215E7-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:09.026389] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43666][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215E8-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:09.036007] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310687216140002, v:0}, replayable_scn:{val:1719310687216140002, v:0}, standby_scn:{val:1719310687216140002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310689034463, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310687216140002, v:0}, replayable_scn:{val:1719310687216140002, v:0}, standby_scn:{val:1719310687216140002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310689034463, ora_rowscn_=1719310688433470001)
[2024-06-25 18:18:09.070080] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C32-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:09.267017] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C31-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:09.438865] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C7E-0-0] [lt=12] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310688869974004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310688869974003, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310688869974003, v:0}}])
[2024-06-25 18:18:09.563517] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000B-0-0] [lt=9] start do ObArchiveSchedulerService round(round=3096)
[2024-06-25 18:18:09.564662] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000B-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:09.564678] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000B-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:09.564705] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000B-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:09.564718] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000B-0-0] [lt=13][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:09.564735] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000B-0-0] [lt=17][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:09.650932] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C2F-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:09.684325] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF62000A-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:09.748184] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA82000B-0-0] [lt=17] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:09.792495] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4BB-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:09.818450] INFO  [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2244) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65F-0-0] [lt=15] need check schema(new_schema_version=1719298380350128, cached_tenant_schema_version=1719298380350128, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT column_value FROM __all_core_table WHERE TABLE_NAME = ? AND COLUMN_NAME = ? FOR UPDATE)
[2024-06-25 18:18:09.818697] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65F-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1719310689818652000, start_id=1719310689818652000, end_id=1719310689818652001)
[2024-06-25 18:18:09.819700] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F65F-0-0] [lt=9] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310689818652000, v:0}, tenant_id=1)
[2024-06-25 18:18:09.947530] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C1F-0-0] [lt=14] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:10.062948] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:18:10.062969] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=18] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:18:10.062975] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=5] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:18:10.070162] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C33-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:10.090960] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:18:10.090981] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=18] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:18:10.090986] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=5] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:18:10.192777] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=8] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:10.194040] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=20] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310690192695, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:18:10.194058] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310695194056, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:18:10.197034] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:10.198206] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310690196952, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:18:10.198224] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=16] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310695198222, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:10.259061] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A559-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:10.267104] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C32-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:10.445008] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C7F-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310689870738004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310689870738004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310689870738004, v:0}}])
[2024-06-25 18:18:10.450681] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215EB-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:10.640955] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA72000C-0-0] [lt=17] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:10.651020] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C30-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:10.825984] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C00B-0-0] [lt=21] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:10.826599] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C00C-0-0] [lt=4] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:10.827515] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C00D-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:10.827863] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43668][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C00E-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:10.828326] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C011-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:10.828705] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C012-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:10.829285] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C013-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:18:10.829625] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C014-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:18:10.830037] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C015-0-0] [lt=11] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:10.830270] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43655][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C016-0-0] [lt=19] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:10.831076] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C017-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:10.948278] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C20-0-0] [lt=17] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:11.070248] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C34-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:11.267192] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C33-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:11.323351] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=45] start checking lost replicas
[2024-06-25 18:18:11.451125] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C80-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310690872452004, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310690872452004, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310690872452004, v:0}}])
[2024-06-25 18:18:11.466598] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310691034565, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310689218893002, v:0}, replayable_scn:{val:1719310689218893002, v:0}, standby_scn:{val:1719310689218893002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:11.564808] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000C-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3097)
[2024-06-25 18:18:11.565808] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000C-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:11.565821] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000C-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:11.565845] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000C-0-0] [lt=5][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:11.565853] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000C-0-0] [lt=7][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:11.565857] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000C-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:11.651079] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C31-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:11.685082] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF62000B-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL)
[2024-06-25 18:18:11.750420] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA82000C-0-0] [lt=16] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:11.792939] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4BC-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:18:11.949040] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C21-0-0] [lt=15] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:12.036424] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310690219472002, v:0}, replayable_scn:{val:1719310690219472002, v:0}, standby_scn:{val:1719310690219472002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310692033960, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310690219472002, v:0}, replayable_scn:{val:1719310690219472002, v:0}, standby_scn:{val:1719310690219472002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310692033960, ora_rowscn_=1719310691460121000)
[2024-06-25 18:18:12.070332] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C35-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:12.259455] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A55A-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:12.267288] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C34-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:12.458146] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C81-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310692365261001, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310692453550001, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310692453550001, v:0}}])
[2024-06-25 18:18:12.462132] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C81-0-0] [lt=13] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310690219472002, v:0})
[2024-06-25 18:18:12.641309] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA72000D-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:12.651173] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C32-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:12.949742] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C22-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:13.040537] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=5] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:13.040557] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310698040553, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:13.070410] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C36-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:13.184133] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C019-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:13.267436] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C35-0-0] [lt=20] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:13.463868] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C82-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310693363628000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310693445284001, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310693445284001, v:0}}])
[2024-06-25 18:18:13.467911] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C82-0-0] [lt=14] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310693462744000, v:0}, readable_scn:{val:1719310693445284001, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})
[2024-06-25 18:18:13.565923] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000D-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3098)
[2024-06-25 18:18:13.566910] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000D-0-0] [lt=15][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:13.566923] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000D-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:13.566947] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000D-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:13.566955] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000D-0-0] [lt=8][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:13.566960] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000D-0-0] [lt=4][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:13.598413] INFO  [RS.LB] idle (ob_root_balancer.cpp:103) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072B-0-0] [lt=9] root balance idle(idle_time=10000000)
[2024-06-25 18:18:13.598436] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1936) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=14] start try disaster recovery
[2024-06-25 18:18:13.598443] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] start try tenant disaster recovery(tenant_id=1, only_for_display=false)
[2024-06-25 18:18:13.599224] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=8] start try ls disaster recovery(ls_status_info={tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:13.602533] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=20] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:18:13.602553] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.602580] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] try locality alignment(dr_ls_info={resource_tenant_id_:1, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1, ls_id:{id:1}, replicas:[{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:13.602662] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=79] build ls locality stat map(tenant_id=1, ls_id={id:1})
[2024-06-25 18:18:13.602668] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.602674] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.602679] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.602683] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304498322573, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:2, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:2, in_pool:true, unit:unit_id:2, resource_pool_id:1, unit_group_id:1, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498659138, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1, in_pool:true, unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304498075250, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:3, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:3, in_pool:true, unit:unit_id:3, resource_pool_id:1, unit_group_id:1, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:13.602742] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=53] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.602751] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.602756] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.602759] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.603870] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] try tenant disaster recovery succ(tenant_id=1, only_for_display=false)
[2024-06-25 18:18:13.603881] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=10] start try tenant disaster recovery(tenant_id=1001, only_for_display=false)
[2024-06-25 18:18:13.604515] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:13.607565] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=14] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1001, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:18:13.607588] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=20] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.607594] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1001, ls_id:{id:1}, replicas:[{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1001, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:13.607675] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=79] build ls locality stat map(tenant_id=1001, ls_id={id:1})
[2024-06-25 18:18:13.607681] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.607688] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=7] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.607692] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.607698] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304503479254, create_time_us:1718182981315983, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304503971519, create_time_us:1718182981315429, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182982169590, create_time_us:1718182981317507, tenant_id:1001, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:13.607755] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=52] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.607764] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.607771] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.607775] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.608759] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] try tenant disaster recovery succ(tenant_id=1001, only_for_display=false)
[2024-06-25 18:18:13.610137] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2011) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=9] start try tenant disaster recovery(tenant_id=1002, only_for_display=false)
[2024-06-25 18:18:13.611411] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=11] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:13.615003] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=15] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1}, acc_dr_task=0)
[2024-06-25 18:18:13.615024] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=18] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.615031] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1}, replicas:[{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:13.615112] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=79] build ls locality stat map(tenant_id=1002, ls_id={id:1})
[2024-06-25 18:18:13.615119] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.615126] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=7] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.615130] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.615134] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504401380, create_time_us:1718182995547832, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504857611, create_time_us:1718182995548005, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718182995950203, create_time_us:1718182995545761, tenant_id:1002, ls_id:{id:1}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:13.615192] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=53] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.615199] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.615206] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.615211] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.616169] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:13.623047] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=13] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1001}, acc_dr_task=0)
[2024-06-25 18:18:13.623068] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=17] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.623075] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1001}, replicas:[{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:13.623154] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=77] build ls locality stat map(tenant_id=1002, ls_id={id:1001})
[2024-06-25 18:18:13.623160] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.623165] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.623172] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.623176] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304504281285, create_time_us:1718183016807959, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304504758306, create_time_us:1718183016808877, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.52:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016988629, create_time_us:1718183016808493, tenant_id:1002, ls_id:{id:1001}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:13.623251] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=70] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.623261] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.623268] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.623273] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.624127] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=7] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:13.631046] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=12] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1002}, acc_dr_task=0)
[2024-06-25 18:18:13.631067] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=18] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.631073] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1002}, replicas:[{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1002}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone2", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:13.631153] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=78] build ls locality stat map(tenant_id=1002, ls_id={id:1002})
[2024-06-25 18:18:13.631160] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.631166] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=5] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.631170] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.631174] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304500413460, create_time_us:1718183016847312, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.51:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:3, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017472623, create_time_us:1718183016847373, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183016990747, create_time_us:1718183016853347, tenant_id:1002, ls_id:{id:1002}, server:"10.10.10.53:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:13.631231] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=52] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.631242] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=7] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.631249] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.631253] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.632147] INFO  [RS.LB] try_tenant_disaster_recovery (ob_disaster_recovery_worker.cpp:2031) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] start try ls disaster recovery(ls_status_info={tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}})
[2024-06-25 18:18:13.639300] INFO  [RS.LB] try_remove_permanent_offline_replicas (ob_disaster_recovery_worker.cpp:2493) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=13] finish try remove permanent offline replica(ret=0, ret="OB_SUCCESS", tenant_id=1002, ls_id={id:1003}, acc_dr_task=0)
[2024-06-25 18:18:13.639321] INFO  [RS.LB] try_replicate_to_unit (ob_disaster_recovery_worker.cpp:2796) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=18] finish try replicate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.639328] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] try locality alignment(dr_ls_info={resource_tenant_id_:1002, zone_locality_array_:[{zone:"zone1", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone1"]}, {zone:"zone2", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone2"]}, {zone:"zone3", replica_attr_set:{full_replica_attr_array:[{num:1, memstore_percent:100}], logonly_replica_attr_array:[], readonly_replica_attr_array:[], encryption_logonly_replica_attr_array:[]}, zone_set:["zone3"]}], inner_ls_info_:{tenant_id:1002, ls_id:{id:1003}, replicas:[{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, {modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}]}, ls_status_info_:{tenant_id:1002, ls_id:{id:1003}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone3", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}, server_stat_array_:[{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, {server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}], unit_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], unit_in_group_stat_array_:[{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, {unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}], schema_replica_cnt_:3, schema_full_replica_cnt_:3, member_list_cnt_:3, paxos_replica_number_:3, has_leader_:true}, only_for_display=false)
[2024-06-25 18:18:13.639410] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:278) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=80] build ls locality stat map(tenant_id=1002, ls_id={id:1003})
[2024-06-25 18:18:13.639416] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone1, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.639423] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=7] ls zone locality map info(zone=zone2, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.639427] INFO  [RS.LB] build_locality_stat_map (ob_disaster_recovery_worker.cpp:358) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls zone locality map info(zone=zone3, zone_replica_desc=[{replica_type_:0, memstore_percent_:100, replica_num_:1}])
[2024-06-25 18:18:13.639431] INFO  [RS.LB] build_replica_stat_map (ob_disaster_recovery_worker.cpp:401) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] ls replica stat(replica_stat_map=[{replica_:{modify_time_us:1719304505608534, create_time_us:1718183016887872, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.51:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1001, zone:"zone2", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1001, in_pool:true, unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone2", server:"10.10.10.51:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.51:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1718183017471564, create_time_us:1718183016891222, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.52:2882", sql_port:2881, role:2, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:0, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1002, zone:"zone1", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1002, in_pool:true, unit:unit_id:1002, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"10.10.10.52:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.52:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}, {replica_:{modify_time_us:1719304506091130, create_time_us:1718183016888720, tenant_id:1002, ls_id:{id:1003}, server:"10.10.10.53:2882", sql_port:2881, role:1, member_list:[{server:"10.10.10.51:2882", timestamp:1}, {server:"10.10.10.52:2882", timestamp:1}, {server:"10.10.10.53:2882", timestamp:1}], replica_type:0, proposal_id:5, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1003, zone:"zone3", paxos_replica_number:3, data_size:0, required_size:0, in_member_list:true, member_time_us:1, learner_list:{learner_num:0, learner_array:[]}, in_learner_list:false, rebuild:false}, server_stat_info_:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}, unit_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}, unit_in_group_stat_info_:{unit_id:1003, in_pool:true, unit:unit_id:1003, resource_pool_id:1001, unit_group_id:1001, zone:"zone3", server:"10.10.10.53:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, server_stat:{server:"10.10.10.53:2882", alive:true, active:true, permanent_offline:false, block:false, stopped:false}}}])
[2024-06-25 18:18:13.639490] INFO  [RS.LB] try_locality_alignment (ob_disaster_recovery_worker.cpp:3469) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=53] finish try locality alignment(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.639497] INFO  [RS.LB] try_shrink_resource_pools (ob_disaster_recovery_worker.cpp:3613) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] finish try shrink resource pool(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.639505] INFO  [RS.LB] try_cancel_unit_migration (ob_disaster_recovery_worker.cpp:4355) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=7] finish try cancel migrate unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.639509] INFO  [RS.LB] try_migrate_to_unit (ob_disaster_recovery_worker.cpp:4670) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=3] finish try migrate to unit(ret=0, ret="OB_SUCCESS", acc_dr_task=0)
[2024-06-25 18:18:13.640406] INFO  [RS.LB] try_disaster_recovery (ob_disaster_recovery_worker.cpp:1949) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] try tenant disaster recovery succ(tenant_id=1002, only_for_display=false)
[2024-06-25 18:18:13.640418] INFO  [RS] check (ob_migrate_unit_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=9] start check unit migrate finish
[2024-06-25 18:18:13.640427] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=4] try check migrate unit finish by tenant(tenant_id=1)
[2024-06-25 18:18:13.643857] INFO  [RS] try_check_migrate_unit_finish_by_tenant (ob_migrate_unit_finish_checker.cpp:172) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=6] try check migrate unit finish by tenant(tenant_id=1002)
[2024-06-25 18:18:13.651262] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C33-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:13.658776] INFO  [RS] check (ob_alter_locality_finish_checker.cpp:79) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072C-0-0] [lt=18] start to check alter locality finish
[2024-06-25 18:18:13.659355] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072D-0-0] [lt=21][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.659927] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072D-0-0] [lt=14][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.661078] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072F-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.661606] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072F-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.662165] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:72) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC42072F-0-0] [lt=12] start check shrink resource pool
[2024-06-25 18:18:13.662182] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420730-0-0] [lt=13] start check shrink resource pool(tenant_id=1)
[2024-06-25 18:18:13.662677] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420730-0-0] [lt=5][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.663193] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420730-0-0] [lt=12][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.663228] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:93) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420731-0-0] [lt=12] start check shrink resource pool(tenant_id=1002)
[2024-06-25 18:18:13.663771] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420731-0-0] [lt=8][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.664301] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420731-0-0] [lt=18][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.664333] INFO  [RS] check (ob_shrink_expand_resource_pool_checker.cpp:100) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420731-0-0] [lt=11] finish check shrink resource pool(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:13.664343] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:49) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420731-0-0] [lt=9] start check primary zone
[2024-06-25 18:18:13.664348] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420732-0-0] [lt=4] start check primary zone(tenant_id=1)
[2024-06-25 18:18:13.664884] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420732-0-0] [lt=7][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.664918] INFO  [RS] check (ob_alter_primary_zone_checker.cpp:75) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=11] start check primary zone(tenant_id=1002)
[2024-06-25 18:18:13.665459] WDIAG [RS] find_job (ob_rs_job_table_operator.cpp:334) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=8][errcode=-4008] empty result set(ret=-4008)
[2024-06-25 18:18:13.665492] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:179) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=10] start do unit balance
[2024-06-25 18:18:13.666014] INFO  [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [43229][RootBalance][T1][YB420A0A0A33-00061BB2CC420733-0-0] [lt=8] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1719310693666003})
[2024-06-25 18:18:13.666149] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215EC-0-0] [lt=10] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:13.669413] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=12] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:18:13.669429] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=16] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:18:13.669433] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:18:13.669438] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:363) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=3] start distribute for server status change
[2024-06-25 18:18:13.669485] INFO  [RS.LB] distribute_for_server_status_change (ob_server_balancer.cpp:414) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=4] finish distribute for server status change(ret=0)
[2024-06-25 18:18:13.669493] INFO  [RS.LB] balance_servers (ob_server_balancer.cpp:213) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=8] finish do unit balance(ret=0)
[2024-06-25 18:18:13.673155] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=3] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1004)
[2024-06-25 18:18:13.673171] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=15] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1005)
[2024-06-25 18:18:13.673175] INFO  [RS.LB] gather_stat (ob_unit_stat_manager.cpp:111) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=4] unit not in unit_stat_map, set required_size as 0(ret=0, ret="OB_SUCCESS", unit->unit_id_=1006)
[2024-06-25 18:18:13.673183] INFO  [RS.LB] tenant_group_balance (ob_server_balancer.cpp:128) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=4] start to do tenant group unit balance
[2024-06-25 18:18:13.673201] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=4] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone1, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.16210938GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:18:13.673228] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=21] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone2, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:130GB, data_disk_in_use:4.21875GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:18:13.673246] INFO  [RS.LB] check_can_execute_rebalance (ob_server_balancer.cpp:898) [43229][RootBalance][T0][YB420A0A0A33-00061BB2CC420733-0-0] [lt=13] cannot execute server rebalance: Server resource_info and unit_manager sum_load not equal(zone=zone3, resource_info={cpu_capacity:22, cpu_assigned:4, cpu_assigned_max:4, mem_capacity:"40GB", mem_assigned:"4GB", mem_in_use:0GB, log_disk_capacity:120GB, log_disk_assigned:12GB, data_disk_capacity:180GB, data_disk_in_use:4.14648438GB}, sum_load={unit_config_id:18446744073709551615, name:"", resource:{min_cpu:14, max_cpu:22, memory_size:"40GB", log_disk_size:"102GB", min_iops:9223372036854775805, max_iops:9223372036854775805, iops_weight:13}})
[2024-06-25 18:18:13.685794] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF62000C-0-0] [lt=47] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL)
[2024-06-25 18:18:13.752987] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA82000D-0-0] [lt=16] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:13.793429] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4BD-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:13.803477] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2C2-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:13.950705] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C23-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:14.070496] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C37-0-0] [lt=12] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:14.259838] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A55B-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:18:14.267522] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C36-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:14.468522] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310694034419, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310692461040000, v:0}, replayable_scn:{val:1719310692461040000, v:0}, standby_scn:{val:1719310692461040000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:14.469970] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C83-0-0] [lt=22] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310694375638000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310694375638000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310694375638000, v:0}}])
[2024-06-25 18:18:14.515580] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:14.641724] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA72000E-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:14.651346] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C34-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:14.951658] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C24-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:15.036474] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310693461670000, v:0}, replayable_scn:{val:1719310693461670000, v:0}, standby_scn:{val:1719310693461670000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310695034474, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310693461670000, v:0}, replayable_scn:{val:1719310693461670000, v:0}, standby_scn:{val:1719310693461670000, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310695034474, ora_rowscn_=1719310694478632000)
[2024-06-25 18:18:15.070574] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C38-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:15.194146] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:15.195616] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310695194056, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:18:15.195637] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=19] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310700195635, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:18:15.198312] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:15.199577] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310695198222, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:18:15.199596] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310700199595, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:15.267607] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C37-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:15.475912] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C84-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310695376736000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310695376736000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310695376736000, v:0}}])
[2024-06-25 18:18:15.567028] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000E-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3099)
[2024-06-25 18:18:15.568170] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000E-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:15.568180] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000E-0-0] [lt=10][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:15.568206] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000E-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:15.568220] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000E-0-0] [lt=14][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:15.568226] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000E-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:15.651430] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C35-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:15.686146] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF62000D-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:18:15.755583] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA82000E-0-0] [lt=17] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:15.793832] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4BE-0-0] [lt=11] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL)
[2024-06-25 18:18:15.952513] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C25-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:16.070617] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C39-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:16.260282] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A55C-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL)
[2024-06-25 18:18:16.267693] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C38-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:16.481887] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C85-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310696378137000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310696378137000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310696378137000, v:0}}])
[2024-06-25 18:18:16.642129] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA72000F-0-0] [lt=17] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:16.651508] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C36-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:16.953332] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C26-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:17.070702] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C3A-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:17.267789] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C39-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:17.470531] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310697034329, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310695224317002, v:0}, replayable_scn:{val:1719310695224317002, v:0}, standby_scn:{val:1719310695224317002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:17.487584] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C86-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310697278980000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310697278980000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310697278980000, v:0}}])
[2024-06-25 18:18:17.568300] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000F-0-0] [lt=8] start do ObArchiveSchedulerService round(round=3100)
[2024-06-25 18:18:17.569258] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000F-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:17.569273] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000F-0-0] [lt=15][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:17.569296] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000F-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:17.569308] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000F-0-0] [lt=12][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:17.569314] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB2000F-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:17.601820] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:17.651593] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C37-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:17.686513] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF62000E-0-0] [lt=18] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:17.758283] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA82000F-0-0] [lt=24] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:17.794295] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4BF-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:17.954252] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C27-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:18.036739] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310696225575002, v:0}, replayable_scn:{val:1719310696225575002, v:0}, standby_scn:{val:1719310696225575002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310698034282, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310696225575002, v:0}, replayable_scn:{val:1719310696225575002, v:0}, standby_scn:{val:1719310696225575002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310698034282, ora_rowscn_=1719310697494711000)
[2024-06-25 18:18:18.040639] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=6] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:18.040668] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=24] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310703040664, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:18.070790] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C3B-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:18.260687] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A55D-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:18.267867] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C3A-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:18.493821] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C87-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310698379547000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310698379547000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310698379547000, v:0}}])
[2024-06-25 18:18:18.642510] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720010-0-0] [lt=15] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:18.651685] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C38-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:18.955150] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C28-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:19.070876] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C3C-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:19.267952] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C3B-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:19.452373] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A33-00061BB2D01215EE-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:19.499700] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C88-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310699380158000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310699380158000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310699380158000, v:0}}])
[2024-06-25 18:18:19.569388] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20010-0-0] [lt=4] start do ObArchiveSchedulerService round(round=3101)
[2024-06-25 18:18:19.570631] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20010-0-0] [lt=14][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:19.570646] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20010-0-0] [lt=14][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:19.570689] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20010-0-0] [lt=22][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:19.570703] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20010-0-0] [lt=13][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:19.570708] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20010-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:19.651790] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C39-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:19.686879] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF62000F-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL)
[2024-06-25 18:18:19.760546] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820010-0-0] [lt=17] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:19.794746] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4C0-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:18:19.822235] INFO  [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2244) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F660-0-0] [lt=12] need check schema(new_schema_version=1719298380350128, cached_tenant_schema_version=1719298380350128, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT column_value FROM __all_core_table WHERE TABLE_NAME = ? AND COLUMN_NAME = ? FOR UPDATE)
[2024-06-25 18:18:19.822499] INFO  [STORAGE.TRANS] get_number (ob_id_service.cpp:390) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F660-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1719310699821799000, start_id=1719310699821799000, end_id=1719310699821799001)
[2024-06-25 18:18:19.823459] INFO  [RS] renew_snapshot_gc_scn (ob_major_merge_info_manager.cpp:340) [44203][T1_FrzInfoDet][T1][YB420A0A0A33-00061BB2CA41F660-0-0] [lt=16] renew snapshot_gc_scn(ret=0, new_snapshot_gc_scn={val:1719310699821799000, v:0}, tenant_id=1)
[2024-06-25 18:18:19.956028] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C29-0-0] [lt=18] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:20.063190] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=3] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1001, compaction_scn={val:0, v:0})
[2024-06-25 18:18:20.063210] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=16] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509691949)
[2024-06-25 18:18:20.063215] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44240][T1001_MergeSche][T1001][Y0-0000000000000000-0-0] [lt=5] major_merge_scheduler is paused(tenant_id=1001, idle_time_us=10000000, epoch=4)
[2024-06-25 18:18:20.071008] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C3D-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:20.091281] INFO  [RS.COMPACTION] clear_cached_info (ob_major_merge_progress_checker.cpp:152) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=4] success to clear cached info(ret=0, ret="OB_SUCCESS", tenant_id=1002, compaction_scn={val:0, v:0})
[2024-06-25 18:18:20.091301] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:210) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=17] clear cached info when idling(ret=0, ret="OB_SUCCESS", start_ts=1719304509742035)
[2024-06-25 18:18:20.091307] INFO  [RS.COMPACTION] try_idle (ob_major_merge_scheduler.cpp:204) [44259][T1002_MergeSche][T1002][Y0-0000000000000000-0-0] [lt=6] major_merge_scheduler is paused(tenant_id=1002, idle_time_us=10000000, epoch=4)
[2024-06-25 18:18:20.195719] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:20.197383] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310700195635, delay:5000000, job_id:0, tenant_id:1001}, job_key=0x2af4ba4dc0a0, job_infos=[])
[2024-06-25 18:18:20.197402] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=17] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310705197400, delay:5000000, job_id:0, tenant_id:1001})
[2024-06-25 18:18:20.199670] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=7] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:20.200881] INFO  [RS] load_and_register_new_jobs (ob_dbms_job_master.cpp:614) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=8] load and register new jobs(ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310700199595, delay:5000000, job_id:0, tenant_id:1002}, job_key=0x2af4ba4dc0e0, job_infos=[])
[2024-06-25 18:18:20.200897] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:true, check_new_tenant:false, execute_at:1719310705200896, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:20.261163] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A55E-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:20.268035] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C3C-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:20.472468] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=35] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310700034987, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310698227676002, v:0}, replayable_scn:{val:1719310698227676002, v:0}, standby_scn:{val:1719310698227676002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:20.506117] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C89-0-0] [lt=13] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310700381293000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310700381293000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310700381293000, v:0}}])
[2024-06-25 18:18:20.508685] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=18] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.510868] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=40] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.512857] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=38] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.541804] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=42] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.567163] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.568916] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=20] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.582799] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.642993] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720011-0-0] [lt=14] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:20.651928] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C3A-0-0] [lt=17] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:20.832192] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.832947] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=15] failed to get result(ret=-4008)
[2024-06-25 18:18:20.833003] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403704194, start_date_:1718373600000000, last_date_:1718978400000779, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:7054546, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603738087, start_date_:1718632800000000, last_date_:1719237600000767, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:7182242, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306137823202, start_date_:1718269337418154, last_date_:1719306137418936, this_date_:0, next_date_:1719392537418154, end_date_:64060560000000000, total_:2642272, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007201952035, start_date_:1718402400000000, last_date_:1719007200000866, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:4741093, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603749582, start_date_:1718488800000000, last_date_:1719093600000690, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:7242320, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892004284235, start_date_:1718287200000000, last_date_:1718892000000847, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:8227853, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719202175465, start_date_:1718719200000000, last_date_:1718719200000726, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:2174739, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805604724120, start_date_:1718200800000000, last_date_:1718805600000742, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:37147500, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:18:20.834555] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=51] failed to get result(ret=-4008)
[2024-06-25 18:18:20.834596] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403130376, start_date_:1718373600000000, last_date_:1718978400003681, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:6132367, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237601947143, start_date_:1718632800000000, last_date_:1719237600003445, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:5102524, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306194546834, start_date_:1718269394113443, last_date_:1719306194115039, this_date_:0, next_date_:1719392594113443, end_date_:64060560000000000, total_:3284449, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007200659206, start_date_:1718402400000000, last_date_:1719007200007246, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:2269654, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093603091085, start_date_:1718488800000000, last_date_:1719093600003492, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:5856845, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892003073665, start_date_:1718287200000000, last_date_:1718892000003898, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:5290345, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719203797237, start_date_:1718719200000000, last_date_:1718719200004208, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:3793029, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805602049343, start_date_:1718200800000000, last_date_:1718805600003825, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:13517012, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:18:20.837519] INFO  [RS] get_dbms_sched_job_infos_in_tenant (ob_dbms_sched_table_operator.cpp:583) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=45] failed to get result(ret=-4008)
[2024-06-25 18:18:20.837551] INFO  [RS] check_new_jobs (ob_dbms_sched_job_master.cpp:642) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718978403755745, start_date_:1718373600000000, last_date_:1718978400009636, this_date_:0, next_date_:1719583200000000, end_date_:64060560000000000, total_:9178981, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719237603214741, start_date_:1718632800000000, last_date_:1719237600008773, this_date_:0, next_date_:1719842400000000, end_date_:64060560000000000, total_:8157181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719306206300927, start_date_:1718269406072562, last_date_:1719306206074204, this_date_:0, next_date_:1719392606072562, end_date_:64060560000000000, total_:2552147, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719007204300685, start_date_:1718402400000000, last_date_:1719007200014486, this_date_:0, next_date_:1719612000000000, end_date_:64060560000000000, total_:7423181, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1719093604691429, start_date_:1718488800000000, last_date_:1719093600010541, this_date_:0, next_date_:1719698400000000, end_date_:64060560000000000, total_:9650110, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718892005643742, start_date_:1718287200000000, last_date_:1718892000009893, this_date_:0, next_date_:1719496800000000, end_date_:64060560000000000, total_:13725944, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718719207006246, start_date_:1718719200000000, last_date_:1718719200016920, this_date_:0, next_date_:1719324000000000, end_date_:64060560000000000, total_:6989326, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1718805605317652, start_date_:1718200800000000, last_date_:1718805600009364, this_date_:0, next_date_:1719410400000000, end_date_:64060560000000000, total_:23735393, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}])
[2024-06-25 18:18:20.837595] INFO  [RS] check_all_tenants (ob_dbms_sched_job_master.cpp:631) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=43] check all tenants(ret=0)
[2024-06-25 18:18:20.840118] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=4] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.844110] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.871400] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.873920] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.876325] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.877598] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.887341] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=9] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.890709] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.893489] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=11] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.897134] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=10] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.903687] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=12] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.907960] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=40] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.913165] INFO  [RS] scheduler (ob_dbms_sched_job_master.cpp:344) [43234][DBMS_SCHEDULER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0)
[2024-06-25 18:18:20.956762] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C2A-0-0] [lt=19] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:21.037094] INFO  [RS] refresh_tenant_info (ob_tenant_info_loader.cpp:627) [43987][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26] refresh tenant info(ret=0, ret="OB_SUCCESS", new_tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310699228336002, v:0}, replayable_scn:{val:1719310699228336002, v:0}, standby_scn:{val:1719310699228336002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, new_refresh_time_us=1719310701035300, tenant_id=1002, tenant_info_={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310699228336002, v:0}, replayable_scn:{val:1719310699228336002, v:0}, standby_scn:{val:1719310699228336002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}}, last_sql_update_time_=1719310701035300, ora_rowscn_=1719310700512210000)
[2024-06-25 18:18:21.071096] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C3E-0-0] [lt=20] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:21.268118] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C3D-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:21.326324] INFO  [RS] check_lost_replicas (ob_lost_replica_checker.cpp:117) [43228][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=14] start checking lost replicas
[2024-06-25 18:18:21.512469] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C8A-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310701382829000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310701382829000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310701382829000, v:0}}])
[2024-06-25 18:18:21.570791] INFO  [RS] run2 (ob_archive_scheduler_service.cpp:84) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20011-0-0] [lt=5] start do ObArchiveSchedulerService round(round=3102)
[2024-06-25 18:18:21.572033] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:947) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20011-0-0] [lt=13][errcode=-4018] no row exist(ret=-4018)
[2024-06-25 18:18:21.572045] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:620) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20011-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from __all_log_archive_dest_parameter where tenant_id = 1 AND dest_no = 0 AND name = 'state', exec_tenant_id=1)
[2024-06-25 18:18:21.572074] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:176) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20011-0-0] [lt=6][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:21.572093] WDIAG [SHARE] get_item (ob_inner_kv_table_operator.cpp:353) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20011-0-0] [lt=18][errcode=-4018] failed to get item(ret=-4018, item={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}}, need_lock=false)
[2024-06-25 18:18:21.572099] WDIAG [SHARE] get_string_value (ob_archive_persist_helper.cpp:410) [43483][T1_ArchiveSvr][T1][YB420A0A0A33-00061BB2CAB20011-0-0] [lt=5][errcode=-4018] failed to get item(ret=-4018, need_lock=false, item_with_tenant_id={tenant_id:1, *item:{dest_no:0, name:"state", *value:{value:}}})
[2024-06-25 18:18:21.651991] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C3B-0-0] [lt=10] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:21.687656] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43158][LeaseQueueTh0][T0][YB420A0A0A33-00061BB2CF620010-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL)
[2024-06-25 18:18:21.763063] INFO  [RS] manage_heartbeat_ (ob_heartbeat_service.cpp:408) [43550][T1_HBService][T1][YB420A0A0A33-00061BB2CA820011-0-0] [lt=21] manage_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:21.795201] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43159][LeaseQueueTh1][T0][YB420A0A0A35-00061BB2CBD3B4C1-0-0] [lt=15] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)
[2024-06-25 18:18:21.957499] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C2B-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:22.071174] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C3F-0-0] [lt=13] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:22.185861] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A35-00061BB2CD23C01B-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:22.191856] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2C3-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=3, ddl_arg=NULL)
[2024-06-25 18:18:22.194566] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2C8-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=2, ddl_arg=NULL)
[2024-06-25 18:18:22.195468] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43643][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2C9-0-0] [lt=17] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL)
[2024-06-25 18:18:22.196100] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2CA-0-0] [lt=14] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL)
[2024-06-25 18:18:22.196457] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43653][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2CB-0-0] [lt=3] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:22.196696] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2CC-0-0] [lt=45] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL)
[2024-06-25 18:18:22.197520] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43654][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2CD-0-0] [lt=13] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL)
[2024-06-25 18:18:22.261730] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43160][LeaseQueueTh2][T0][YB420A0A0A34-00061BB2CBF0A55F-0-0] [lt=16] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL)
[2024-06-25 18:18:22.268202] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C3E-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:22.519610] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C8B-0-0] [lt=11] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310702383172000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310702383172000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310702383172000, v:0}}])
[2024-06-25 18:18:22.523978] INFO  [RS] update_replayable_point_from_tenant_info_ (ob_ls_recovery_reportor.cpp:440) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C8B-0-0] [lt=13] update_replayable_point_from_tenant_info_ success(ret=0, ret="OB_SUCCESS", replayable_scn={val:1719310700229284002, v:0})
[2024-06-25 18:18:22.643379] INFO  [RS] send_heartbeat_ (ob_heartbeat_service.cpp:276) [43549][T1_HBService][T1][YB420A0A0A33-00061BB2CA720012-0-0] [lt=15] send_heartbeat_ has finished one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:22.652079] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43989][T1002_StandbySc][T1002][YB420A0A0A33-00061BB2C7320C3C-0-0] [lt=16] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:22.803758] INFO  [RS] process_ (ob_rs_rpc_processor.h:232) [43652][T1_L0_G0][T1][YB420A0A0A34-00061BB2CEE0B2CF-0-0] [lt=12] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL)
[2024-06-25 18:18:22.958392] INFO  [RS] do_work (ob_common_ls_service.cpp:138) [43473][T1_COMMONLSSe][T1][YB420A0A0A33-00061BB2CAF20C2C-0-0] [lt=16] [COMMON_LS_SERVICE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", idle_time_us=1000000)
[2024-06-25 18:18:23.040746] INFO  [RS] scheduler (ob_dbms_job_master.cpp:329) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=5] dbms job master wait timeout, no entry(ret=-4018)
[2024-06-25 18:18:23.040764] INFO  [RS] scheduler (ob_dbms_job_master.cpp:342) [43233][DBMS_JOB_MASTER][T0][YB420A0A0A33-00061BB2C861F3F4-0-0] [lt=13] success to scheduler single dbms job(ret=0, tmp_ret=0, job_key={check_job:false, check_new:false, check_new_tenant:true, execute_at:1719310708040760, delay:5000000, job_id:0, tenant_id:1002})
[2024-06-25 18:18:23.071256] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43472][T1_StandbySchem][T1][YB420A0A0A33-00061BB2C5320C40-0-0] [lt=15] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:23.268301] INFO  [RS] do_work (ob_standby_schema_refresh_trigger.cpp:70) [43747][T1001_StandbySc][T1001][YB420A0A0A33-00061BB2C5F20C3F-0-0] [lt=14] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS")
[2024-06-25 18:18:23.474541] INFO  [RS] get_valid_sts_after (ob_tenant_info_loader.cpp:414) [44098][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18] get_valid_sts_after(ret=-4076, ret="OB_NEED_WAIT", specified_time_us=0, last_sql_update_time=1719310703035161, tenant_info={tenant_id:1002, tenant_role:{value:1}, switchover_status:{value:1}, switchover_epoch:0, sync_scn:{val:1719310701230371002, v:0}, replayable_scn:{val:1719310701230371002, v:0}, standby_scn:{val:1719310701230371002, v:0}, recovery_until_scn:{val:4611686018427387903, v:0}, log_mode:{archive mode:"NOARCHIVELOG"}, max_ls_id:{id:1003}})
[2024-06-25 18:18:23.526029] INFO  [RS] gather_replica_readable_scn (ob_ls_recovery_stat_handler.cpp:494) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C8C-0-0] [lt=10] ls readable scn in memory(ret=0, ret="OB_SUCCESS", ls_id={id:1002}, replicas_scn_=[{server:"10.10.10.51:2882", readable_scn:{val:1719310703384713000, v:0}}, {server:"10.10.10.52:2882", readable_scn:{val:1719310703384713000, v:0}}, {server:"10.10.10.53:2882", readable_scn:{val:1719310702884454004, v:0}}])
[2024-06-25 18:18:23.530548] INFO  [RS] update_ls_recovery (ob_ls_recovery_reportor.cpp:336) [43990][T1002_TeRec][T1002][YB420A0A0A33-00061BB2C7420C8C-0-0] [lt=13] tenant update ls recovery stat(ret=0, ret="OB_SUCCESS", ls_recovery_stat={tenant_id:1002, ls_id:{id:1002}, sync_scn:{val:1719310703384713000, v:0}, readable_scn:{val:1719310703384713000, v:0}, create_scn:{val:1, v:0}, drop_scn:{val:1, v:0}, config_version_:{proposal_id:3, config_seq:4}})